-- Logs begin at Mon 2022-08-29 21:47:46 UTC, end at Mon 2022-08-29 23:31:31 UTC. -- Aug 29 22:34:42.286504 dv-cinder-854268-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 22:34:42.296808 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:34:42 2022] *** Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: nodename: dv-cinder-854268-3-iscsi Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: machine: x86_64 Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: clock source: unix Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: pcre jit disabled Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: detected number of CPU cores: 4 Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: current working directory: / Aug 29 22:34:42.297912 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:34:42.298488 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: your processes number limit is 47680 Aug 29 22:34:42.298488 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: your memory page size is 4096 bytes Aug 29 22:34:42.298488 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: detected max file descriptor number: 2048 Aug 29 22:34:42.298488 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: lock engine: pthread robust mutexes Aug 29 22:34:42.298488 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: thunder lock: enabled Aug 29 22:34:42.298488 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 22:34:42.298488 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:34:42.338552 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: Python main interpreter initialized at 0x5620a7c139c0 Aug 29 22:34:42.338552 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: python threads support enabled Aug 29 22:34:42.338552 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: your server socket listen backlog is limited to 100 connections Aug 29 22:34:42.338552 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:34:42.338953 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:34:42.338953 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: *** Operational MODE: preforking *** Aug 29 22:34:42.339224 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:34:42.339224 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: spawned uWSGI master process (pid: 113108) Aug 29 22:34:42.339423 dv-cinder-854268-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 22:34:42.339979 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: spawned uWSGI worker 1 (pid: 113109, cores: 1) Aug 29 22:34:42.340400 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: spawned uWSGI worker 2 (pid: 113110, cores: 1) Aug 29 22:34:42.340574 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:34:43.003369 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:34:43.024048 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:34:44.095282 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:34:44.095282 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: from cryptography.utils import int_from_bytes Aug 29 22:34:44.095871 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:34:44.095871 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: from cryptography.utils import int_from_bytes Aug 29 22:34:44.099502 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:34:44.099502 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: from cryptography.utils import int_from_bytes Aug 29 22:34:44.099928 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:34:44.099928 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: from cryptography.utils import int_from_bytes Aug 29 22:34:46.621657 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:34:46.622234 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:34:46.622425 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:34:46.622777 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:34:46.623016 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:34:46.623368 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:34:46.623466 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:34:46.623555 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.623703 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.623790 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:34:46.624017 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.624186 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:34:46.624352 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.624453 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:34:46.624691 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.624816 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.625025 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.625187 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.625279 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.625458 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.625605 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.625771 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.625880 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.626102 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.626200 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.626411 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.626504 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.626729 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854268-3-iscsi {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.626817 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.627044 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.627149 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.627347 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.627443 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.627617 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.627727 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.627933 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.628040 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.628252 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.628345 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854268-3-iscsi {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.628568 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.628677 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.628864 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.628968 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.629186 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.629361 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.629548 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.629798 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.629936 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.630099 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.630210 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.630404 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.630683 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.630793 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.630911 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.631031 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.631772 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.632286 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.632391 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.632483 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.632602 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.632722 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.632802 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.632929 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.633042 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.633129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.633351 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.633482 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854268-3-iscsi {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.633672 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.633815 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.633980 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.634072 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.634305 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.634397 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.634613 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.634775 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.635015 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854268-3-iscsi {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.635101 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.635560 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.635668 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.635813 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.635903 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.635994 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.636079 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.636297 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.636385 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.636617 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.636718 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.636931 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.637022 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.637244 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.637335 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.637559 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.637692 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.637852 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.637946 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.638153 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.638249 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.638455 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.638627 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.638767 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.638861 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.639064 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.639152 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.639363 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.639456 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.639607 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.639698 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.639908 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.640000 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.640241 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.640331 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.640557 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.640650 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.640873 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.640969 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.641121 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.641207 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.641367 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.641453 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.641678 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.641771 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.641991 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.642084 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.642292 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.642377 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.642594 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.642690 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.642848 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.642940 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.643169 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.643262 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.643467 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.643552 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.643768 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.643861 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.644066 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.644177 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.644389 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.644475 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.644700 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.644792 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.645006 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.645086 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.645314 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.645401 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.645613 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.645695 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.645919 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.646008 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.646240 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.646326 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.646540 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.646624 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.646889 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.647513 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.647720 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.647816 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.648033 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.648120 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.648359 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.648579 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.648671 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.648837 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.648977 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.649149 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.649281 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.649493 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.649578 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.649814 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.649899 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.650123 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.650215 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.650444 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.650529 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.650765 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.650849 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.651008 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.651100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.651302 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.651387 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.651601 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.651685 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.651912 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.652005 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.652236 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.652327 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.652537 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.652632 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.652841 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.652934 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.653132 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.653217 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.653431 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.653522 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.653731 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.653828 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.654031 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.654114 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.654329 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.654420 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.654627 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.654712 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.654922 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.655013 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.655219 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.655348 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.655516 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.655609 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.655814 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.655905 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.656118 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.656225 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.656446 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.656531 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.656744 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.656833 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.657042 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.657125 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.657339 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.657436 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.657637 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.657747 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.657952 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.658079 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.658252 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.658336 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.658552 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.658644 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.658854 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.658938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.659154 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.659239 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.659453 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.659550 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.659764 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.659857 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.660066 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.660178 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.660392 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.660476 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.660704 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.660800 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.661000 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.661085 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.661300 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.661384 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.661609 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.661704 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.661909 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.662001 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.662207 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.662293 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.662552 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.662726 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.662878 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.663000 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.663178 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.663316 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.663478 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.663639 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.663775 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.663948 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.664073 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.664285 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.664372 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.664590 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.664682 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.664898 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.664983 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.665205 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.665291 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.665546 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.665634 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.665803 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.665889 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.666120 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.666226 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.666458 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.666558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.666729 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.666817 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.667053 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.667147 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.667362 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.667450 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.667670 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.667755 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.667982 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.668161 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.668333 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:34:46.668434 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.668674 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.668759 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.668980 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.669065 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.669301 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.669387 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.669610 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.669694 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.669916 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.670008 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.670222 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.670308 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.670535 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.670621 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.670848 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.670940 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.671171 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.671266 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.671482 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.671566 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.671792 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.671876 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.672101 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.672233 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.672427 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.672512 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.672743 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.672828 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.673063 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.673148 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.673378 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.673461 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.673682 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.673767 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.674002 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.674084 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.674325 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.674425 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.674630 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.674714 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.674945 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.675029 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.675259 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.675351 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.675565 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.675650 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.675868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.675961 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.676189 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.676291 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.676506 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.676592 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.676830 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.676915 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.677136 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.677230 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.677449 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.677535 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.677754 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.677838 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.678637 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.678789 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.678882 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.678961 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.679181 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.679267 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.679527 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.679613 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.679842 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.679926 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.680212 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.680301 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.680481 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.680567 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.680796 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.680880 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.681104 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.681196 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.681410 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.681497 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.681714 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.681800 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.682021 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.682104 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.682325 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.682410 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.682629 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.682714 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.682931 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.683025 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.683233 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.683325 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.683527 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.683620 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.683824 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.683917 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.684126 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.684224 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.684441 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.684525 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.684754 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.684850 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.685073 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.685164 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.685370 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.685453 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.685672 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.685765 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.685976 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.686068 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.686289 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.686383 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.686579 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.686681 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.686876 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.686990 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.687180 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.687323 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.687580 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.687688 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.687768 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.687845 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.688064 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.688234 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.688406 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.688488 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.688698 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.688811 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.688998 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.689096 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.689315 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.689400 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.689611 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.689694 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.689911 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.690005 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.690216 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.690309 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.690518 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.690602 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.690821 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.690914 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.691125 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.691210 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.691430 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.691522 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.691732 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.691824 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.692035 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.692155 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.692363 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.692466 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.692673 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.692770 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.693067 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.693160 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.693290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.693379 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.693597 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.693689 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.694539 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.694699 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.694797 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.695062 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.695155 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.695365 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.695460 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.695662 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.695787 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.695958 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.696093 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.696276 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.696430 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.696654 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.696762 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.696897 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.697075 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.697153 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.697395 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.697479 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.697703 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.697801 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.698008 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.698100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.698313 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.698403 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.698613 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.698710 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.698911 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.699009 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.699205 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.699290 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.699503 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.699597 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.699808 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.699900 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.700116 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.700228 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.700447 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.700542 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.700752 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.700852 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.701078 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.701163 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.701392 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.701540 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.701697 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.701784 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.701999 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.702089 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.702303 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.702388 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.702610 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.702694 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.702915 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.703001 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.703227 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.703312 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.703541 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.703625 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.703848 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.703933 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.704178 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.704278 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.704486 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.704571 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.704806 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.704905 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.705110 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.705197 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.705422 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.705507 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.705722 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.705820 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.706032 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.706123 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.706358 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.706450 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.706673 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.706767 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.706981 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.707065 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.707293 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.707384 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.707594 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.707687 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.707902 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.708063 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.708237 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.708333 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.708541 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.708640 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.708844 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.708930 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.709146 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.709232 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.709483 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.709584 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.709787 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.709989 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.710127 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.710316 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.710411 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.710632 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.710719 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.710951 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.711044 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.711263 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.711360 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.711559 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.711644 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.711865 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.711949 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.712206 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.712308 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.712518 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.712603 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.712817 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.712902 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.713127 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.713213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.713436 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.713520 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.713737 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.713820 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.714037 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.714123 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.714341 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.714426 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.714639 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.714726 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.714936 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.715021 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.715238 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.715322 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.715545 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.715630 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.715847 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.715933 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.716156 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.716245 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.716466 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.716564 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.716774 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.716858 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.717354 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.717491 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.717572 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.717720 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.717802 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.717887 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.717965 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.718040 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.718248 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.718343 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.718550 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.718636 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.718864 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.718956 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.719176 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.719269 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.719473 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.719558 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.719771 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.719857 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.720078 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.720201 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.720410 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.720504 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.720707 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.720791 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.721005 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.721098 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.721302 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.721388 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.721625 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.721708 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.721926 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.722011 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.722222 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.722307 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.722531 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.722615 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.722835 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.722920 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.723140 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.723223 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.723452 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.723547 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.723757 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.723843 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.724059 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.724160 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.724388 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.724485 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.724693 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.724784 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.725024 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.725116 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.725326 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.725602 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.725688 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.725919 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.726002 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.726222 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.726307 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.726535 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.726621 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.726837 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.726921 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.727140 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.727233 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.727444 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.727529 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.727739 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.727823 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.728040 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.728175 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.728370 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.728455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.728745 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.728942 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.729060 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.729268 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.729374 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.729576 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.729932 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.730143 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.730263 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.730455 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.730575 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.730799 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.730898 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.731121 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.731207 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.731443 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.731537 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.731749 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.731833 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.732049 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.732155 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.732374 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.732656 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.732743 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.732954 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.733039 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.733262 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.733355 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.733560 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.733653 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.733857 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.733942 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.734153 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.734252 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.734478 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.734589 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.734751 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.734874 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.735045 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.735189 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.735338 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.735496 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.735632 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.735804 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.735937 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.736110 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.736270 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.736439 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.736546 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.736751 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.736843 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.737057 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.737253 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.737350 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.737436 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.737652 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.737784 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.737963 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.738058 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.738268 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.738352 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.738571 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.738656 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.738872 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.738968 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.739175 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.739260 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.739490 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.739575 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.739794 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.739879 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.740103 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.740315 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.740421 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.740518 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.741294 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.741389 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.741596 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.741693 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.741986 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.742117 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.742383 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.742480 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.742560 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.742663 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.742862 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.743012 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.743157 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.743319 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.743462 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.743659 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.743769 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.743988 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.744074 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.744358 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.744459 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.744666 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.744759 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.744970 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.745063 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.745264 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.745348 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.745571 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.745669 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.745871 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.745957 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.746165 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.746250 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.746459 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.746555 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.746762 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.746855 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.747060 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.747145 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.747434 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.747537 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.747654 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.747740 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.747947 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.748038 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.748275 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.748377 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.748572 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.748657 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.748867 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.748951 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.749160 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.749254 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.749462 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.749547 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.749761 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.749845 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.750053 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.750139 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.750352 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.750436 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.750658 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.750741 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.750955 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.751042 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.751253 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.751337 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.751552 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.751636 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.751848 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.751934 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.752186 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.752275 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.752467 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.752563 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.752766 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.752851 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.753070 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.753155 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.753362 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.753463 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.753668 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.753753 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.753964 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.754048 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.754262 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.754356 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.754557 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.754649 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.754856 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.754941 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.755150 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.755243 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.755446 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.755531 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.755740 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.755825 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.756035 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.756128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.756967 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.757065 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.757563 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.757671 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.757768 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.757848 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.757914 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.757997 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.758203 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.758297 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.758511 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.758598 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.758817 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.758910 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.759120 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.759206 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.759429 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.759516 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.759731 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.759816 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.760032 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.760117 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.760361 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.760449 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.760664 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.760756 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.760965 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.761059 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.761268 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.761353 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.761565 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.761649 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.761872 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.761966 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.762173 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.762300 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.762475 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.762562 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.762767 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.762861 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.763064 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.763149 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.763376 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.763469 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.763679 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.763774 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.763986 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.764071 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.764323 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.764410 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.764641 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.764729 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.764957 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.765046 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.765253 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.765338 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.765556 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.765655 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.765857 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.765942 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.766158 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.766243 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.766460 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.766546 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.766761 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.766845 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.767065 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.767160 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.767368 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.767455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.767671 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.767758 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.767973 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.768068 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.768295 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.768384 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.768596 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.768680 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.768898 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.769000 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.769200 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.769288 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.769495 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.769579 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.769800 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.769898 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.770099 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.770183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.770393 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.770478 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.770695 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.770855 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.770991 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.771076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.771291 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.771377 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.771586 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.771672 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.771947 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.772082 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.772411 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.772497 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.772716 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.772859 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.773014 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.773176 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.773316 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.773490 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.773621 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.773796 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.773936 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.774122 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.774242 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.774434 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.774528 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.774739 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.774942 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.775049 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.775250 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.775343 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.775555 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.775641 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.775859 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.775951 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.776194 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.776389 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.776477 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.776702 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.776795 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.777014 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.777104 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.777320 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.777407 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.777630 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.777716 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.777923 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.778013 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.778238 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.778324 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.778535 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.778621 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.778838 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.778921 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.779246 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.779339 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.779552 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.779649 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.779851 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.779944 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.780178 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.780275 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.780488 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.780575 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.780792 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.780887 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.781102 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.781191 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.781428 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.781515 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.781733 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.781831 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.782035 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.782122 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.782338 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.782431 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.782639 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.782724 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.782950 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.783034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.783262 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.783370 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.783566 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.783664 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.783878 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.783972 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.784199 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.784289 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.784516 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.784689 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.784831 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.785000 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.785136 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.785316 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.785448 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.785637 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.785854 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.785949 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.786172 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.786265 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.786476 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.786562 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.786793 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.786880 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.787111 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.787196 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.787429 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.787533 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.787729 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.787819 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.788035 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.788148 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.788435 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.788531 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.788737 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.788824 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.789054 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.789140 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.789353 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.789451 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.789658 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.789751 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.789962 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.790048 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.790267 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.790387 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.790562 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.790710 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.790858 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.791021 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.791173 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.791343 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.791469 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.791668 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.791782 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.791972 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.792090 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.792310 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.792429 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.792620 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.792744 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.792923 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.793025 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.793241 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.793333 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.793551 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.793641 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.793856 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.793949 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.794165 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.794259 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.794473 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.794559 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.794782 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.794868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.795089 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.795174 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.795392 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.795487 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.795714 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.795807 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.796015 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.796108 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.796373 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.796459 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.796686 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.796773 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.797009 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.797104 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.797320 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.797408 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.797624 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.797718 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.797938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.798022 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.798237 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.798331 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.798533 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.798618 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.798832 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.798916 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.799128 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.799221 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.799428 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.799513 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.799725 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.799818 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.800027 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.800120 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.800344 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.800441 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.800641 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.800726 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.800937 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.801035 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.801251 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.801337 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.801546 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.801632 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.801860 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.801947 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.802161 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.802254 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.802458 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.802543 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.802753 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.802846 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.803564 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.803667 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.803946 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.804191 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.804295 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.804487 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.804580 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.804795 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.804888 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.805101 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.805196 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.805417 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.805502 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.805720 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.805805 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.806023 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.806109 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.806331 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.806449 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.806643 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.806738 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.806947 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.807042 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.807255 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.807370 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.807562 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.807656 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.807861 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.807949 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.808185 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.808277 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.808491 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.808577 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.808836 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.809040 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.809133 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.809362 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.809447 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.809673 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.809759 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.809980 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.810065 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.810288 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.810373 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.810598 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.810686 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.810903 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.810988 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.811207 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.811292 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.811510 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.811608 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.811815 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.811901 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.812120 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.812265 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.812463 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.812550 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.812778 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.812871 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.813089 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.813182 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.813408 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.813493 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.813725 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.813959 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.814045 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.814289 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.814376 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.814604 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.814689 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.814919 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.815011 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.815238 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.815324 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.815537 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.815629 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.815842 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.815935 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.816167 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.816256 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.816481 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.816565 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.816784 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.816879 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.817088 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.817174 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.817394 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.817483 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.817698 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.817787 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.818004 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.818089 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.818307 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.818400 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.818611 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.818717 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.819466 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.819710 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.819944 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.820030 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.820315 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.820404 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.820635 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.820720 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.820945 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.821047 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.821256 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.821343 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.821567 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.821652 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.821913 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.822078 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.822234 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.822384 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.822551 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.822708 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.822865 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.823026 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.823181 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.823344 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.823498 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.823652 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.823812 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.823967 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.824123 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.824308 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.824461 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.824606 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.824775 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.824903 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.825100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.825194 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.825443 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.825529 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.825764 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.825852 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.826077 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.826170 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.826378 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.826472 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.826674 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.826760 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.826988 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.827200 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.827286 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.827547 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.827805 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.827946 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.828244 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.828398 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.828534 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.828639 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.828780 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.828867 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.829097 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.829182 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.829407 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.829502 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.829708 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.829841 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.830013 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.830098 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.830314 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.830430 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.830614 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.830734 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.830915 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.831000 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.831217 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.831310 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.831517 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.831604 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.831815 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.831907 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.832119 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.832241 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.832447 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.832541 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.832747 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.832985 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.833125 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.833336 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.833420 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.833655 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.833738 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.833960 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.834047 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.834261 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.834863 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.835146 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.835233 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.835458 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.835545 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.835758 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.835844 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.836058 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.836196 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.836382 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.836474 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.836679 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.836763 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.836984 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.837078 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.837511 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.837617 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.837686 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.837760 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.837871 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.837956 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.838240 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.838327 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.838474 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.838559 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.838780 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.838874 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.839136 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.839221 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.839460 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.839545 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.839759 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.839852 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.840059 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.840165 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.840397 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.840484 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.840702 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.840837 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.841008 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.841093 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.841312 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.841396 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.841617 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.841703 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.841923 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.842009 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.842237 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.842324 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.842545 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.842805 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.842890 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.843135 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.843227 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.843446 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.843543 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.843750 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.843835 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.844061 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.844259 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.844410 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.844513 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.844714 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.844799 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.845014 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.845100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.845335 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.845422 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.845641 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.845727 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.845947 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.846032 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.846253 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.846351 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.846560 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.846652 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.846866 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.846951 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.847171 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.847257 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.847478 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.847591 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.847783 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.848055 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.848161 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.848418 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.848522 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.848721 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.848819 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.849025 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.849120 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.849329 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.849414 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.849631 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.849725 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.849993 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.850702 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.850856 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.850983 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.851175 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.851422 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.851519 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.851778 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.851871 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.852089 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.852289 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.852417 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.852609 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.852721 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.852929 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.853015 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.853244 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.853339 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.853559 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.853653 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.853874 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.853960 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.854186 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.854280 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.854498 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.854591 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.855079 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.855171 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.855392 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.855479 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.855704 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.855789 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.856014 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.856100 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.856348 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.856439 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.856664 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.856750 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.857009 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.857109 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.857315 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.857411 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.857630 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.857714 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.857932 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.858029 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.858251 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.858342 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.858559 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.858644 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.858868 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.858966 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.859177 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.859264 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.859479 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.859565 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.859777 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.859871 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.860074 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.860178 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.860399 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.860485 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.860714 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.860808 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.861018 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.861139 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.861315 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.861451 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.861610 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.861767 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.861912 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.862088 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.862208 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.862399 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.862494 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.862721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.862807 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.863042 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.863136 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.863353 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.863450 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.863680 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.863777 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.863941 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.864028 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.864260 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.864351 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.864557 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.864644 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.864853 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.864945 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.865149 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.865261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.865451 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.865623 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.865925 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.866056 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.866222 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.866308 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.866561 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.866671 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.866858 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.866963 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.867176 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.867332 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.867478 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.867565 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.867779 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.867894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.868090 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.868206 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.868420 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.868506 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.868725 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.868871 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.869030 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.869116 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.869330 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.869415 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.869638 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.869736 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.869942 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.870027 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.870242 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.870327 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.870544 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.870636 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.870843 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.870926 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.871146 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.871232 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.871449 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.871543 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.871800 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.871892 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.872054 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.872169 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.872380 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.872467 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.872680 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.872765 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.872985 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.873077 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.873288 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.873381 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.873592 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.873679 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.873920 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.874031 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.874231 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.874317 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.874543 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.874632 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.874849 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.874948 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.875152 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.875237 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.875473 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.875556 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.875776 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.875869 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.876079 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.876219 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.876408 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.876496 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.876713 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.876800 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.877017 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.877111 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.877325 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.877414 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.877628 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.877715 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.877969 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.878067 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.878241 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.878339 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.878550 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.878643 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.878862 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.878951 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.879174 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.879267 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.879476 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.879563 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.879790 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.879875 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.880106 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.880222 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.880456 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.880541 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.880760 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.880844 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.881077 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.881222 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.881483 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.881571 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.881795 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.881925 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.882102 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.882246 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.882401 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.882560 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.882646 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:34:46.882874 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.883189 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.883500 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.883816 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.884130 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.884463 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.884780 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.885097 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.885430 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.885757 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.886069 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.886397 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.886723 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.887075 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.887390 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.887737 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.888068 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.888410 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.888725 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.889031 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:34:46.889277 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:34:47.040834 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO dbcounter [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Registered counter for database nova_api Aug 29 22:34:47.045454 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO dbcounter [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Registered counter for database nova_api Aug 29 22:34:47.062633 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_db.sqlalchemy.engines [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:34:47.065604 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_db.sqlalchemy.engines [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:34:47.070361 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writer thread running {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:34:47.072995 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writer thread running {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:34:47.126958 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.context [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ef697b0-8690-4044-8ada-38684217d1b2(cell1) {{(pid=113110) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:34:47.129052 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.context [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ef697b0-8690-4044-8ada-38684217d1b2(cell1) {{(pid=113109) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:34:47.130736 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:34:47.131723 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:34:47.133478 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:34:47.133580 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_concurrency.lockutils [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:34:47.134041 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_concurrency.lockutils [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:34:47.134203 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:34:47.134639 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:34:47.135622 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_concurrency.lockutils [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:34:47.136371 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_concurrency.lockutils [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:34:47.136626 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:34:47.136817 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_concurrency.lockutils [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:34:47.138579 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO dbcounter [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Registered counter for database nova_cell0 Aug 29 22:34:47.138821 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_concurrency.lockutils [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:34:47.140877 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO dbcounter [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Registered counter for database nova_cell0 Aug 29 22:34:47.142620 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO dbcounter [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Registered counter for database nova_cell1 Aug 29 22:34:47.146224 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO dbcounter [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Registered counter for database nova_cell1 Aug 29 22:34:47.150710 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_db.sqlalchemy.engines [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:34:47.152458 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_db.sqlalchemy.engines [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:34:47.154801 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_db.sqlalchemy.engines [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:34:47.156639 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_db.sqlalchemy.engines [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:34:47.158667 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writer thread running {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:34:47.160920 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writer thread running {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:34:47.163064 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writer thread running {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:34:47.165621 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writer thread running {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:34:47.305581 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO dbcounter [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Registered counter for database nova_cell0 Aug 29 22:34:47.309261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO dbcounter [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Registered counter for database nova_cell0 Aug 29 22:34:47.312492 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_db.sqlalchemy.engines [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:34:47.317303 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writer thread running {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:34:47.317764 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG oslo_db.sqlalchemy.engines [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:34:47.322334 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writer thread running {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:34:47.722340 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: WARNING keystonemiddleware.auth_token [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:34:47.730553 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: WARNING keystonemiddleware.auth_token [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:34:47.741806 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: WARNING keystonemiddleware.auth_token [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:34:47.749235 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: WARNING keystonemiddleware.auth_token [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:34:48.071360 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: WARNING keystonemiddleware.auth_token [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:34:48.077205 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: WARNING keystonemiddleware.auth_token [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:34:48.082431 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5620a7c139c0 pid: 113110 (default app) Aug 29 22:34:48.085092 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:34:48.086286 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002342 Aug 29 22:34:48.086698 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Mon Aug 29 22:34:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:34:48.090342 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: WARNING keystonemiddleware.auth_token [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:34:48.096368 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: WARNING keystonemiddleware.auth_token [None req-6504a4ec-0baf-48e0-a7ea-6352aa7d68ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:34:48.101831 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5620a7c139c0 pid: 113109 (default app) Aug 29 22:36:17.257359 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:17.259330 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002315 Aug 29 22:36:17.260236 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:36:17.277531 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writing DB stats nova_api:SELECT=3 {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:17.279709 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writing DB stats nova_cell0:SELECT=3 {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:17.281211 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writing DB stats nova_cell1:SELECT=3 {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:17.282289 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:18.181366 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-882a0a1e-9a05-46d0-b3cf-044158ec196b admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:18.215263 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-882a0a1e-9a05-46d0-b3cf-044158ec196b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.944365 Aug 29 22:36:18.216009 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Mon Aug 29 22:36:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:20.617764 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:20.618773 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-aa378ae8-fb27-4744-a378-47cd8d50abb4 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Aug 29 22:36:20.620419 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:21.103094 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-5bc5259c-73ea-4d70-9e7b-8f0f311f1a2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:21.253037 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-5bc5259c-73ea-4d70-9e7b-8f0f311f1a2b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.626994 Aug 29 22:36:21.255216 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:36:21.481529 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-67e30797-e756-479c-bdfa-cc2cf16322b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:21.488906 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_api:SELECT=3 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:21.489765 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_cell1:SELECT=3 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:21.490693 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_cell0:SELECT=3 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:21.491387 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:21.603524 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-67e30797-e756-479c-bdfa-cc2cf16322b5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.340973 Aug 29 22:36:21.604031 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Mon Aug 29 22:36:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:24.042105 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-5bc5259c-73ea-4d70-9e7b-8f0f311f1a2b admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:24.043218 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-5bc5259c-73ea-4d70-9e7b-8f0f311f1a2b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 29 22:36:24.044128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:24.743785 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-6cce1205-46b5-4f0a-996b-c1030379bf37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:24.911757 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-6cce1205-46b5-4f0a-996b-c1030379bf37 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.860052 Aug 29 22:36:24.912362 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:36:24.926773 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-dd3af44f-d40c-4260-9069-ac6d8857946e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:25.050592 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-dd3af44f-d40c-4260-9069-ac6d8857946e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128365 Aug 29 22:36:25.052478 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Mon Aug 29 22:36:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:27.509752 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-6cce1205-46b5-4f0a-996b-c1030379bf37 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:27.510775 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-6cce1205-46b5-4f0a-996b-c1030379bf37 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 29 22:36:27.511178 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:27.930347 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-3ef7b3e5-3dc2-47f2-a122-90b2b605f716 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "disk": 10}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:28.000488 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-3ef7b3e5-3dc2-47f2-a122-90b2b605f716 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482361 Aug 29 22:36:28.001152 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:36:28.014760 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-0fc56897-6661-41b6-a1be-e08c1331e73b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:28.093082 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-0fc56897-6661-41b6-a1be-e08c1331e73b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082247 Aug 29 22:36:28.093687 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Mon Aug 29 22:36:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:30.583718 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-3ef7b3e5-3dc2-47f2-a122-90b2b605f716 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:30.584743 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-3ef7b3e5-3dc2-47f2-a122-90b2b605f716 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 29 22:36:30.585390 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:31.055172 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-826f8bdb-d2e2-4b95-b066-b301ec2408f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "name": "ds2G"}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:31.140599 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-826f8bdb-d2e2-4b95-b066-b301ec2408f8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.548333 Aug 29 22:36:31.141395 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:36:31.155785 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-70257d9b-b831-43dc-a4f9-36a97bc620bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:31.251944 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-70257d9b-b831-43dc-a4f9-36a97bc620bf admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099702 Aug 29 22:36:31.268608 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Mon Aug 29 22:36:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:33.863047 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-826f8bdb-d2e2-4b95-b066-b301ec2408f8 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:33.864123 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-826f8bdb-d2e2-4b95-b066-b301ec2408f8 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002452 Aug 29 22:36:33.864556 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:34.334355 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-41a5ec91-512a-40f4-80cf-56b09d120066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "vcpus": 4, "swap": 0}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:34.432434 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-41a5ec91-512a-40f4-80cf-56b09d120066 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.561019 Aug 29 22:36:34.435015 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:36:34.446333 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-8e38d2ec-96f7-48ef-9235-3909109cc3d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:34.539391 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-8e38d2ec-96f7-48ef-9235-3909109cc3d4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096729 Aug 29 22:36:34.539992 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Mon Aug 29 22:36:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:36.982097 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-41a5ec91-512a-40f4-80cf-56b09d120066 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:36.983113 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-41a5ec91-512a-40f4-80cf-56b09d120066 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 29 22:36:36.983564 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:37.448624 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-338182d4-0734-4b95-b37b-69c896caf756 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:37.475717 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-338182d4-0734-4b95-b37b-69c896caf756 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.485220 Aug 29 22:36:37.476289 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Mon Aug 29 22:36:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:36:40.061855 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-41a5ec91-512a-40f4-80cf-56b09d120066 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:40.063404 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-41a5ec91-512a-40f4-80cf-56b09d120066 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002407 Aug 29 22:36:40.063989 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:40.504766 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-1331b0dd-5b18-4d83-a889-599a6a6940e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "id": "1", "name": "m1.tiny"}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:40.576919 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-1331b0dd-5b18-4d83-a889-599a6a6940e9 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.506303 Aug 29 22:36:40.577653 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:36:40.590476 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-21d5af9f-6a8d-4ee9-9fef-85f980a4a1d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:40.679394 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-21d5af9f-6a8d-4ee9-9fef-85f980a4a1d0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092722 Aug 29 22:36:40.679979 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Mon Aug 29 22:36:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:43.052545 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-1331b0dd-5b18-4d83-a889-599a6a6940e9 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:43.053595 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-1331b0dd-5b18-4d83-a889-599a6a6940e9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Aug 29 22:36:43.053959 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:43.482089 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-14484e78-dc08-4935-bd48-0e27e41fd22b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:43.579542 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-14484e78-dc08-4935-bd48-0e27e41fd22b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.519245 Aug 29 22:36:43.580121 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:36:43.592596 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-ae23c9f7-00d5-4431-af5e-fceed864c6d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:43.712268 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-ae23c9f7-00d5-4431-af5e-fceed864c6d6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123322 Aug 29 22:36:43.712862 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Mon Aug 29 22:36:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:46.126180 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-14484e78-dc08-4935-bd48-0e27e41fd22b admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:46.127223 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-14484e78-dc08-4935-bd48-0e27e41fd22b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 29 22:36:46.127614 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:46.641317 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-06f04587-a817-4071-ba00-04a617ffe944 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "disk": 40}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:46.745188 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-06f04587-a817-4071-ba00-04a617ffe944 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.610839 Aug 29 22:36:46.745988 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:36:46.759610 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-fe92e8a0-8631-46f5-bdc9-d0b2c2e4aac3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:46.878547 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-fe92e8a0-8631-46f5-bdc9-d0b2c2e4aac3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122993 Aug 29 22:36:46.879133 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Mon Aug 29 22:36:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:49.388700 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-06f04587-a817-4071-ba00-04a617ffe944 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:49.390444 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-06f04587-a817-4071-ba00-04a617ffe944 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Aug 29 22:36:49.396512 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:49.861675 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-eb5997fa-c766-4beb-90d6-8cc484d67304 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:49.872926 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:36:49.943465 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-eb5997fa-c766-4beb-90d6-8cc484d67304 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.545267 Aug 29 22:36:49.948321 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:36:49.957064 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-3ebf9328-2387-43a5-9659-581ce78843d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:50.069468 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-3ebf9328-2387-43a5-9659-581ce78843d1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116706 Aug 29 22:36:50.076254 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Mon Aug 29 22:36:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:36:52.497427 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-eb5997fa-c766-4beb-90d6-8cc484d67304 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:36:52.498350 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-eb5997fa-c766-4beb-90d6-8cc484d67304 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 29 22:36:52.498746 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:36:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:36:53.028423 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-1865759c-2839-46b7-a410-8d690db4b85a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "disk": 160, "rxtx_factor": 1.0}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:53.120683 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-1865759c-2839-46b7-a410-8d690db4b85a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.614936 Aug 29 22:36:53.121629 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Mon Aug 29 22:36:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:36:53.135045 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-c822f2d5-851b-4a68-9ad4-5631927191a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:36:53.226537 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-c822f2d5-851b-4a68-9ad4-5631927191a6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094217 Aug 29 22:36:53.243451 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Mon Aug 29 22:36:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:37:14.202306 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-1865759c-2839-46b7-a410-8d690db4b85a admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:14.203428 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-1865759c-2839-46b7-a410-8d690db4b85a admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Aug 29 22:37:14.204317 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:37:14.812560 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-320ea260-471c-4576-af23-67b820b05f55 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:14.833719 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-320ea260-471c-4576-af23-67b820b05f55 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.622957 Aug 29 22:37:14.834299 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Mon Aug 29 22:37:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:37:16.019704 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-1865759c-2839-46b7-a410-8d690db4b85a admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:16.021521 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-1865759c-2839-46b7-a410-8d690db4b85a admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002556 Aug 29 22:37:16.022242 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:37:16.826264 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-1f4f5673-67a3-431a-9803-153f4740835c admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:16.833206 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.wsgi [None req-1f4f5673-67a3-431a-9803-153f4740835c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-1f4f5673-67a3-431a-9803-153f4740835c admin admin] Request method failure captured: Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Accept: application/json Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Accept-Encoding: gzip, deflate Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Connection: keep-alive Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Content-Length: 0 Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Host: 10.222.0.59 Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Openstack-Api-Version: compute 2.90 Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Openstack-System-Scope: None Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: User-Agent: python-novaclient Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Auth-Token: gAAAAABjDT-b18hG2QhYVLgKm53uhQqYJT3ghkjaFxnSOg-vCkBv-i5vCWvZhrKZVnvsVTCK5AejU_9skYp_b35xCtMIKWryxAh5ozON84JK22ConLGe-pDdop5_fluAekcsJfDxLHYkZEu6R7_AXeyOI0FkUbW9Yef6P4bd9NOgA_lOWqIPMhg Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Domain-Id: None Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Domain-Name: None Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Identity-Status: Confirmed Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Is-Admin-Project: True Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Domain-Id: default Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Domain-Name: Default Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Name: admin Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Role: reader,admin,member Aug 29 22:37:16.836583 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Roles: reader,admin,member Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d3d78b58a69d4b10868c64742da904fe", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Tenant: admin Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Tenant-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Tenant-Name: admin Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User: admin Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Domain-Id: default Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Domain-Name: Default Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Id: b7cd207626714450952ac5fa63cc9cad Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Name: admin Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: method: > Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: exception: Flavor 42 could not be found. Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: action_args: {'id': '42'} Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:37:16.839213 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:16.840721 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:16.843168 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-1f4f5673-67a3-431a-9803-153f4740835c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:37:16.845497 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-1f4f5673-67a3-431a-9803-153f4740835c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.592017 Aug 29 22:37:16.845497 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Mon Aug 29 22:37:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 593 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:16.852881 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-9d1dd708-98d8-4152-829f-4b1fd9c24926 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:16.861097 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:37:16.904872 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-9d1dd708-98d8-4152-829f-4b1fd9c24926 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.058893 Aug 29 22:37:16.906461 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Mon Aug 29 22:37:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:37:16.923491 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-d575fd26-1819-477f-855e-c2f15805d180 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:16.971148 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-d575fd26-1819-477f-855e-c2f15805d180 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.054595 Aug 29 22:37:16.972430 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Mon Aug 29 22:37:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:37:16.982429 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-6abeeb1f-4e7f-430a-ab37-50e2520a7230 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:16.990362 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.wsgi [None req-6abeeb1f-4e7f-430a-ab37-50e2520a7230 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-6abeeb1f-4e7f-430a-ab37-50e2520a7230 admin admin] Request method failure captured: Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Accept: application/json Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Accept-Encoding: gzip, deflate Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Connection: keep-alive Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Content-Length: 0 Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Host: 10.222.0.59 Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Openstack-Api-Version: compute 2.90 Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Openstack-System-Scope: None Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: User-Agent: python-novaclient Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Auth-Token: gAAAAABjDT-b18hG2QhYVLgKm53uhQqYJT3ghkjaFxnSOg-vCkBv-i5vCWvZhrKZVnvsVTCK5AejU_9skYp_b35xCtMIKWryxAh5ozON84JK22ConLGe-pDdop5_fluAekcsJfDxLHYkZEu6R7_AXeyOI0FkUbW9Yef6P4bd9NOgA_lOWqIPMhg Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Domain-Id: None Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Domain-Name: None Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Identity-Status: Confirmed Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Is-Admin-Project: True Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Domain-Id: default Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Domain-Name: Default Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Name: admin Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Role: reader,admin,member Aug 29 22:37:16.994290 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Roles: reader,admin,member Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d3d78b58a69d4b10868c64742da904fe", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Tenant: admin Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Tenant-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Tenant-Name: admin Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User: admin Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Domain-Id: default Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Domain-Name: Default Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Id: b7cd207626714450952ac5fa63cc9cad Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Name: admin Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: method: > Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: exception: Flavor 42 could not be found. Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: action_args: {'id': '42'} Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:37:16.997145 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:16.999034 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:17.002129 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-6abeeb1f-4e7f-430a-ab37-50e2520a7230 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:37:17.004463 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-6abeeb1f-4e7f-430a-ab37-50e2520a7230 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017380 Aug 29 22:37:17.004463 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Mon Aug 29 22:37:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 22:37:18.057915 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-d575fd26-1819-477f-855e-c2f15805d180 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:18.058962 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-d575fd26-1819-477f-855e-c2f15805d180 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 29 22:37:18.059403 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:37:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:37:18.678067 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-be783cfb-eb3d-43b0-8319-7708e9331113 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:18.685254 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.wsgi [None req-be783cfb-eb3d-43b0-8319-7708e9331113 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-be783cfb-eb3d-43b0-8319-7708e9331113 admin admin] Request method failure captured: Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Accept: application/json Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Accept-Encoding: gzip, deflate Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Connection: keep-alive Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Content-Length: 0 Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Host: 10.222.0.59 Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Openstack-Api-Version: compute 2.90 Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Openstack-System-Scope: None Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: User-Agent: python-novaclient Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Auth-Token: gAAAAABjDT-d9WP6Md4viPfYcJdWUaPpbpFgf0dvtUVfFQu9JvYMRASPIaSvkoaRtoImXr5JiQGrqdfnVkeNEbhoFpaoGMM7oPBskWnBUh6NlTavvN-300XvI7F8ym5-TOfOvHcoqkjF8FwcfAv1APmsxaiVwqtTbvb505Ef5btPjRRzxmgtmyI Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Domain-Id: None Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Domain-Name: None Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Identity-Status: Confirmed Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Is-Admin-Project: True Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Domain-Id: default Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Domain-Name: Default Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Name: admin Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Role: reader,admin,member Aug 29 22:37:18.686868 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Roles: reader,admin,member Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d3d78b58a69d4b10868c64742da904fe", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Tenant: admin Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Tenant-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Tenant-Name: admin Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User: admin Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Domain-Id: default Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Domain-Name: Default Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Id: b7cd207626714450952ac5fa63cc9cad Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Name: admin Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: method: > Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: exception: Flavor 84 could not be found. Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: action_args: {'id': '84'} Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:37:18.688938 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:18.689894 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.691013 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-be783cfb-eb3d-43b0-8319-7708e9331113 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:37:18.693018 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-be783cfb-eb3d-43b0-8319-7708e9331113 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.480104 Aug 29 22:37:18.693018 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Mon Aug 29 22:37:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:18.699229 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-1a828487-173f-42bd-8a0d-8641d3e5b9a9 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:18.717920 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-1a828487-173f-42bd-8a0d-8641d3e5b9a9 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022622 Aug 29 22:37:18.718501 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Mon Aug 29 22:37:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:37:18.729526 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-39ca6edc-7f44-4438-a74d-d533d42ea9a0 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:18.746993 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-39ca6edc-7f44-4438-a74d-d533d42ea9a0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021411 Aug 29 22:37:18.747581 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Mon Aug 29 22:37:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:37:18.757611 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-cbe02235-4203-4dbc-a82a-fdd223e0d932 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:18.763675 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.wsgi [None req-cbe02235-4203-4dbc-a82a-fdd223e0d932 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-cbe02235-4203-4dbc-a82a-fdd223e0d932 admin admin] Request method failure captured: Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Accept: application/json Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Accept-Encoding: gzip, deflate Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Connection: keep-alive Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Content-Length: 0 Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Host: 10.222.0.59 Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Openstack-Api-Version: compute 2.90 Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Openstack-System-Scope: None Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: User-Agent: python-novaclient Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Auth-Token: gAAAAABjDT-d9WP6Md4viPfYcJdWUaPpbpFgf0dvtUVfFQu9JvYMRASPIaSvkoaRtoImXr5JiQGrqdfnVkeNEbhoFpaoGMM7oPBskWnBUh6NlTavvN-300XvI7F8ym5-TOfOvHcoqkjF8FwcfAv1APmsxaiVwqtTbvb505Ef5btPjRRzxmgtmyI Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Domain-Id: None Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Domain-Name: None Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Identity-Status: Confirmed Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Is-Admin-Project: True Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Domain-Id: default Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Domain-Name: Default Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Name: admin Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Role: reader,admin,member Aug 29 22:37:18.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Roles: reader,admin,member Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d3d78b58a69d4b10868c64742da904fe", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Tenant: admin Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Tenant-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Tenant-Name: admin Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User: admin Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Domain-Id: default Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Domain-Name: Default Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Id: b7cd207626714450952ac5fa63cc9cad Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Name: admin Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: method: > Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: exception: Flavor 84 could not be found. Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: action_args: {'id': '84'} Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:37:18.768183 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:18.777100 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:18.779128 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-cbe02235-4203-4dbc-a82a-fdd223e0d932 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:37:18.781916 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-cbe02235-4203-4dbc-a82a-fdd223e0d932 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013291 Aug 29 22:37:18.781916 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Mon Aug 29 22:37:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:19.828229 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-39ca6edc-7f44-4438-a74d-d533d42ea9a0 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:19.829443 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-39ca6edc-7f44-4438-a74d-d533d42ea9a0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002708 Aug 29 22:37:19.829875 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:37:20.479724 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-3e29275a-fe49-4b30-a4e9-e5247fefd526 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:20.486748 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.wsgi [None req-3e29275a-fe49-4b30-a4e9-e5247fefd526 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-3e29275a-fe49-4b30-a4e9-e5247fefd526 admin admin] Request method failure captured: Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Accept: application/json Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Accept-Encoding: gzip, deflate Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Connection: keep-alive Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Content-Length: 0 Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Host: 10.222.0.59 Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Openstack-Api-Version: compute 2.90 Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Openstack-System-Scope: None Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: User-Agent: python-novaclient Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Auth-Token: gAAAAABjDT-fo4tATwRKbGWHJGSXtrkTGWSGgE94-qqyjHXyihxD1_5xv410oovNxqiS8YoygFrFIirl36BfDad4RtCFRgIhp350NSxE1mQ9ZOvavP7EgZTqcprnRo7BL0weoRMGtJue63UK8otcI_BgvVY1VPIk3FD1eU0zIQbKHvCin6cIowc Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Domain-Id: None Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Domain-Name: None Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Identity-Status: Confirmed Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Is-Admin-Project: True Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Domain-Id: default Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Domain-Name: Default Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Project-Name: admin Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Role: reader,admin,member Aug 29 22:37:20.488328 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Roles: reader,admin,member Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d3d78b58a69d4b10868c64742da904fe", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Tenant: admin Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Tenant-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-Tenant-Name: admin Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User: admin Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Domain-Id: default Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Domain-Name: Default Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Id: b7cd207626714450952ac5fa63cc9cad Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: X-User-Name: admin Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: method: > Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: exception: Flavor 451 could not be found. Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: action_args: {'id': '451'} Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:37:20.490058 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:20.491455 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.495076 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-3e29275a-fe49-4b30-a4e9-e5247fefd526 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:37:20.498326 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-3e29275a-fe49-4b30-a4e9-e5247fefd526 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.512304 Aug 29 22:37:20.498326 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Mon Aug 29 22:37:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 514 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:20.506556 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-acd7f0dc-6cd4-40e3-bfea-ea9533cc2894 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:20.535544 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-acd7f0dc-6cd4-40e3-bfea-ea9533cc2894 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035653 Aug 29 22:37:20.536632 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Mon Aug 29 22:37:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:37:20.554351 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:20.584379 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.036963 Aug 29 22:37:20.585361 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Mon Aug 29 22:37:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:37:20.603058 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-3dea47e3-023f-46a6-a2b2-1f4e0d09de5c admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:20.613982 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.wsgi [None req-3dea47e3-023f-46a6-a2b2-1f4e0d09de5c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-3dea47e3-023f-46a6-a2b2-1f4e0d09de5c admin admin] Request method failure captured: Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Accept: application/json Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Accept-Encoding: gzip, deflate Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Connection: keep-alive Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Content-Length: 0 Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Host: 10.222.0.59 Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Openstack-Api-Version: compute 2.90 Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Openstack-System-Scope: None Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: User-Agent: python-novaclient Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Auth-Token: gAAAAABjDT-fo4tATwRKbGWHJGSXtrkTGWSGgE94-qqyjHXyihxD1_5xv410oovNxqiS8YoygFrFIirl36BfDad4RtCFRgIhp350NSxE1mQ9ZOvavP7EgZTqcprnRo7BL0weoRMGtJue63UK8otcI_BgvVY1VPIk3FD1eU0zIQbKHvCin6cIowc Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Domain-Id: None Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Domain-Name: None Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Identity-Status: Confirmed Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Is-Admin-Project: True Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Domain-Id: default Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Domain-Name: Default Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Project-Name: admin Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Role: reader,admin,member Aug 29 22:37:20.617052 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Roles: reader,admin,member Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d3d78b58a69d4b10868c64742da904fe", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d3d78b58a69d4b10868c64742da904fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Tenant: admin Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Tenant-Id: d3d78b58a69d4b10868c64742da904fe Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-Tenant-Name: admin Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User: admin Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Domain-Id: default Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Domain-Name: Default Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Id: b7cd207626714450952ac5fa63cc9cad Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: X-User-Name: admin Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: method: > Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: exception: Flavor 451 could not be found. Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: action_args: {'id': '451'} Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:37:20.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:20.619558 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: ERROR nova.api.openstack.wsgi Aug 29 22:37:20.621741 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-3dea47e3-023f-46a6-a2b2-1f4e0d09de5c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:37:20.623990 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-3dea47e3-023f-46a6-a2b2-1f4e0d09de5c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.023468 Aug 29 22:37:20.624294 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Mon Aug 29 22:37:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:37:21.722320 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:21.723392 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 29 22:37:21.723848 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:37:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:37:22.343471 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-686590e8-9a05-4654-bb94-0177ec29ff8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:37:22.468571 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-686590e8-9a05-4654-bb94-0177ec29ff8a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.603201 Aug 29 22:37:22.469611 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Mon Aug 29 22:37:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:37:23.549271 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:23.550936 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002691 Aug 29 22:37:23.551660 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:37:24.192578 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-2c9454c2-702d-4127-92e4-f4c14b42dbf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:37:24.274222 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-2c9454c2-702d-4127-92e4-f4c14b42dbf4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.574649 Aug 29 22:37:24.274808 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Mon Aug 29 22:37:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:37:25.320809 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:25.322133 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001855 Aug 29 22:37:25.322941 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:37:25.990990 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-88c7b975-ca8b-4707-a9e2-80bf7c533a41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:37:26.149101 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-88c7b975-ca8b-4707-a9e2-80bf7c533a41 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.665108 Aug 29 22:37:26.149711 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Mon Aug 29 22:37:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:37:27.219095 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:27.220833 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003076 Aug 29 22:37:27.221523 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:37:28.012478 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-34fb7054-b8fb-4d6a-a64e-8a01e9dc31c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:37:28.093065 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-34fb7054-b8fb-4d6a-a64e-8a01e9dc31c4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.602913 Aug 29 22:37:28.093510 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Mon Aug 29 22:37:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:37:29.729329 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:29.730511 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Aug 29 22:37:29.730915 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:37:30.349461 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-90135111-d551-48c6-a2d9-f55650ee9f69 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:37:30.372390 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-90135111-d551-48c6-a2d9-f55650ee9f69 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.496385 Aug 29 22:37:30.372970 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Mon Aug 29 22:37:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:38:29.753065 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:29.754104 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-d1d293b9-a62c-49d6-9804-085fd5a53619 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 29 22:38:29.754502 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Mon Aug 29 22:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:38:29.766027 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:30.247389 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-d8675387-aba8-4bea-98dd-239a2ad5bf02 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:30.268904 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-d8675387-aba8-4bea-98dd-239a2ad5bf02 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.507791 Aug 29 22:38:30.269476 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Mon Aug 29 22:38:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:38:30.298755 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-cba1d450-d2bc-45cd-99db-31023f82c021 admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:30.305236 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG dbcounter [-] [113109] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=113109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:38:30.314141 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-cba1d450-d2bc-45cd-99db-31023f82c021 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.023178 Aug 29 22:38:30.315054 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Mon Aug 29 22:38:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:30.331888 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-300acd67-bdbc-453b-8842-ce7670f11563 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:30.340978 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-300acd67-bdbc-453b-8842-ce7670f11563 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012084 Aug 29 22:38:30.341743 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Mon Aug 29 22:38:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:38:30.358061 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:30.372574 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021168 Aug 29 22:38:30.375780 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Mon Aug 29 22:38:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:38:30.386230 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-2bb92f51-8066-4be1-8bbf-65ce3682477f admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:38:30.394612 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-2bb92f51-8066-4be1-8bbf-65ce3682477f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012020 Aug 29 22:38:30.395180 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Mon Aug 29 22:38:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:45.039523 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:45.040647 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 29 22:41:45.041045 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:45.185599 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_api:SELECT=6 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:45.380222 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-6bd73873-d01d-4475-8cb8-387e0b5784b0 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:45.384236 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-6bd73873-d01d-4475-8cb8-387e0b5784b0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:45.384730 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-6bd73873-d01d-4475-8cb8-387e0b5784b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:45.385160 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-6bd73873-d01d-4475-8cb8-387e0b5784b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:45.385882 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-6bd73873-d01d-4475-8cb8-387e0b5784b0 admin admin] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:45.386328 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-6bd73873-d01d-4475-8cb8-387e0b5784b0 admin admin] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:45.386745 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-6bd73873-d01d-4475-8cb8-387e0b5784b0 admin admin] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:45.425532 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-6bd73873-d01d-4475-8cb8-387e0b5784b0 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.241215 Aug 29 22:41:45.426137 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Mon Aug 29 22:41:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:46.304067 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:46.305118 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Aug 29 22:41:46.305516 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:46.507014 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-8bb11a00-b642-4100-874b-9d041e35b26f admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:46.518195 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-8bb11a00-b642-4100-874b-9d041e35b26f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.518195 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-8bb11a00-b642-4100-874b-9d041e35b26f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.518195 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-8bb11a00-b642-4100-874b-9d041e35b26f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.518195 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-8bb11a00-b642-4100-874b-9d041e35b26f admin admin] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:46.518195 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-8bb11a00-b642-4100-874b-9d041e35b26f admin admin] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:46.518670 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-8bb11a00-b642-4100-874b-9d041e35b26f admin admin] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:46.532635 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-8bb11a00-b642-4100-874b-9d041e35b26f admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082316 Aug 29 22:41:46.533204 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Mon Aug 29 22:41:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:57.757807 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:57.758911 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 29 22:41:57.759310 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:57.907777 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_cell0:SELECT=4 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:57.908527 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_cell1:SELECT=4 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:57.909143 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG dbcounter [-] [113110] Writing DB stats nova_api:SELECT=8 {{(pid=113110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:57.964595 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-54ed7d44-36be-4051-bdb0-55d08b5ee254 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:57.968186 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-54ed7d44-36be-4051-bdb0-55d08b5ee254 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:57.968667 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-54ed7d44-36be-4051-bdb0-55d08b5ee254 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:57.969097 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-54ed7d44-36be-4051-bdb0-55d08b5ee254 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:57.970076 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-54ed7d44-36be-4051-bdb0-55d08b5ee254 admin admin] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:57.970314 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-54ed7d44-36be-4051-bdb0-55d08b5ee254 admin admin] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:57.970732 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-54ed7d44-36be-4051-bdb0-55d08b5ee254 admin admin] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:57.997826 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-54ed7d44-36be-4051-bdb0-55d08b5ee254 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.094455 Aug 29 22:41:57.998429 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Mon Aug 29 22:41:57 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:58.866152 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: DEBUG nova.api.openstack.wsgi [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] Calling method '>' {{(pid=113109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:58.867296 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: INFO nova.api.openstack.requestlog [None req-5b54285d-53f8-4b3e-bb83-23c692420ccb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002000 Aug 29 22:41:58.867695 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: [pid: 113109|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Mon Aug 29 22:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:59.063581 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG nova.api.openstack.wsgi [None req-d904b17a-a7ed-4231-972b-5f61a4f05cf7 admin admin] Calling method '>' {{(pid=113110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:59.067273 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-d904b17a-a7ed-4231-972b-5f61a4f05cf7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:59.067755 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-d904b17a-a7ed-4231-972b-5f61a4f05cf7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:59.068207 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-d904b17a-a7ed-4231-972b-5f61a4f05cf7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:59.069074 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-d904b17a-a7ed-4231-972b-5f61a4f05cf7 admin admin] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:41:59.069579 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-d904b17a-a7ed-4231-972b-5f61a4f05cf7 admin admin] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:41:59.069956 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: DEBUG oslo_concurrency.lockutils [None req-d904b17a-a7ed-4231-972b-5f61a4f05cf7 admin admin] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:41:59.093169 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: INFO nova.api.openstack.requestlog [None req-d904b17a-a7ed-4231-972b-5f61a4f05cf7 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085124 Aug 29 22:41:59.093744 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: [pid: 113110|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Mon Aug 29 22:41:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:42:58.320427 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: Mon Aug 29 22:42:58 2022 - graceful shutdown triggered... Aug 29 22:42:58.320766 dv-cinder-854268-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 22:42:58.321481 dv-cinder-854268-3-iscsi devstack@n-api.service[113110]: Gracefully killing worker 2 (pid: 113110)... Aug 29 22:42:58.321906 dv-cinder-854268-3-iscsi devstack@n-api.service[113109]: Gracefully killing worker 1 (pid: 113109)... Aug 29 22:42:59.321590 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: worker 1 buried after 1 seconds Aug 29 22:42:59.321590 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: worker 2 buried after 1 seconds Aug 29 22:42:59.322228 dv-cinder-854268-3-iscsi devstack@n-api.service[113108]: goodbye to uWSGI. Aug 29 22:42:59.323203 dv-cinder-854268-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 22:42:59.323842 dv-cinder-854268-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 22:42:59.326736 dv-cinder-854268-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 22:42:59.338378 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:42:59 2022] *** Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: nodename: dv-cinder-854268-3-iscsi Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: machine: x86_64 Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: clock source: unix Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: pcre jit disabled Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: detected number of CPU cores: 4 Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: current working directory: / Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:42:59.340488 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: your processes number limit is 47680 Aug 29 22:42:59.341454 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: your memory page size is 4096 bytes Aug 29 22:42:59.341454 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: detected max file descriptor number: 2048 Aug 29 22:42:59.341454 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: lock engine: pthread robust mutexes Aug 29 22:42:59.341454 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: thunder lock: enabled Aug 29 22:42:59.341454 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 22:42:59.341454 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:42:59.382543 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: Python main interpreter initialized at 0x561055a279c0 Aug 29 22:42:59.382543 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: python threads support enabled Aug 29 22:42:59.382543 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: your server socket listen backlog is limited to 100 connections Aug 29 22:42:59.382543 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:42:59.383007 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:42:59.383007 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: *** Operational MODE: preforking *** Aug 29 22:42:59.383278 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:42:59.383278 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: spawned uWSGI master process (pid: 128135) Aug 29 22:42:59.383489 dv-cinder-854268-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 22:42:59.384248 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: spawned uWSGI worker 1 (pid: 128150, cores: 1) Aug 29 22:42:59.388206 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: spawned uWSGI worker 2 (pid: 128151, cores: 1) Aug 29 22:42:59.388206 dv-cinder-854268-3-iscsi devstack@n-api.service[128135]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:43:00.056527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:43:00.072795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:43:01.224526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:43:01.224526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: from cryptography.utils import int_from_bytes Aug 29 22:43:01.225110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:43:01.225110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: from cryptography.utils import int_from_bytes Aug 29 22:43:01.277663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:43:01.277663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: from cryptography.utils import int_from_bytes Aug 29 22:43:01.278617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:43:01.278617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: from cryptography.utils import int_from_bytes Aug 29 22:43:03.650876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:43:03.651806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:43:03.652590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:43:03.653121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:43:03.653550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:43:03.654093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.654569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.655052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.655528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.656184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.656668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.657155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.657629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.658130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.658554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.659036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.659520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854268-3-iscsi {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.660015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.660499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.660975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.661458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.661927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.662416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.662886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.663654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.665129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.665129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.665363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.665665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.665998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.666330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.666710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.667237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.667728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.668223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.668650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854268-3-iscsi {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.668985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.669312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.669640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.670075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.670396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.670905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.671244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.671611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.672103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.672483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.672816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.673148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.673482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.673796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.674116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.674435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.674769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.675095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.675404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.675666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.675989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.676379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.676729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.677125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.677393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.677804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.678177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.678517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.678838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.679156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.679472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.679789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.680103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.680444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.680793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.681110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.681444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.681771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.682825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.683139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.683528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.683898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.684211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.684534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.684892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.685223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.685540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.685874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.686204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.686521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.686833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.687151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.687559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.688076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.688461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.688690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.689297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.689464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.689734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.690011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.690323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.690641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.690953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.691275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.691587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.691905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.692400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.692731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.693041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.693359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.693679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.693993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.694332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.694663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.694979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.695292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.695605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.695925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.696287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.696604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.696918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.697251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.697644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.698648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.698983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.699447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.699772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.700108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.700448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.700761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.701091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.701410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.701722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.702105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.702573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.702891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.703205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.703517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.703829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.704193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.704497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.704834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.705155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.705723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.706048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.706382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.706729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.707072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.707458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.707783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.708309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.708653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.708989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.709364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.709624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.709960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.710280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.710601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.710917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.711247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.711574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.711920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.712700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.713032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.713363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.714536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.715020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.715479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.715822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.716182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.716536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.716897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.717225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.717562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.718025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.718443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.718667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.718985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.719325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.719695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.719985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.720357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.720761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.721007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.721327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.721644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.721971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.722285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.722757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.723118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.723446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.723778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.724107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.724456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.724802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.725098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.725461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.725802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.726126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.726439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.726753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.727071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.727383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.727714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.728059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.728416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.729044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.730098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.730545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.730872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.731189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.731545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.731873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.732217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.732546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.733202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.733503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.733820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.734156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.734478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.734798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.735135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.737548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.737548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.737548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.737548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.737548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.737548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.738532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.738532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.738532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.739095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.739095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.739428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.739757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.740861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.740861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.740861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.741524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.741524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.741816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.741968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.742280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.742596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.743120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.743368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.743714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.744032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.744372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.744793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.745093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.745455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.745767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.746132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.746479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.746810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.747145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.747466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.747837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.748109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.749050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.749378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.749702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.750035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.750472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.750743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.750991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.751333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.751657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.752098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.752440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.752764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.753505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.753655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.753935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.754264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.754588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.754906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.755227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.756098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.756098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.756390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.756602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.756925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.757251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.757568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.757932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.758221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.758545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.758856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.759181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.759513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.759854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.760203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.761135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.761462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.761786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.762109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.762430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.762740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.763056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.763530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.763859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.764199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.764520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.764835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.765160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.765478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.765791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.766102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.766430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.766764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.767082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.767412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.767743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.768054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.768392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.768723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.769039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.769353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.769663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.769972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.770325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.770642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.770950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.771322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.771595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.771911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.772286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.772591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.772882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.773198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.773669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.773991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.774311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.774630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.774948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.775265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.775596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.775912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.776856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.777170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.777448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.777767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.778120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.778683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.779018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.779340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.780049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.780415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.780771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.781367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.781670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.781998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.782315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.782548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:43:03.783142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.783301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:43:03.783463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.783463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.783880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:43:03.784036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.784214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:43:03.784214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:43:03.784492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.784492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.784776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.784932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.785075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.785224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.785365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.785515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.785656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.785808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.785948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.786095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.786250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.786392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.786544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.786684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.786824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.786975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.787124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.787381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.787536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.787702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.787861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.788002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.788235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.788405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854268-3-iscsi {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.788717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.788871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.789015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.789164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.789314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.789464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.789636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.789862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.790018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.790174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.790333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.790484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.790484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.790768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.790768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.791045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.791206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.791349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.791598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.791880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.792169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.792332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.792483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.792625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.792766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.792916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.793066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.793313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.793459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.793601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.793601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.793895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.793895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.794289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.794289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.794557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.794704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854268-3-iscsi {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.794860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.795010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.795151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.795292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.795432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.795432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.795767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.795910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.796074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.796261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.796412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.796563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.796712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.796854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.796996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.797136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.797277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.797277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.797560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.797817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.798071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.798315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.798484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.798733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.798882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.799030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.799181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.799322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.799470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.799620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.799770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.800009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.800192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.800353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.800508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.800650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.800791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.800947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.801097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.801240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.801390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.801559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.801786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.802036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.802206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.802383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.802535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.802682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.802840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.802989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.803136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.803316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.803552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.803713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.803861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.804009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.804009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.804481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.804640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.804788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.804943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.805092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.805248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.805404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.805560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.805715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.805865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.806011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.806011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.806310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.806477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.806626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.806780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.806937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.807821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.808177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.808399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.808573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.808741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.808986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.808986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.809301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.809469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.809620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.809774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.809924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.810210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.810210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.810520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.810671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.810819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.810966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.811112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.811268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.811441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.811591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.811739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.812027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.812328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.812501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.812658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.812821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.812976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.813126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.813273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.813435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.813714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.813878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.814026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.814175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.814340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.814604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.814765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.814915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.815069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.815217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.815364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.815521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.815521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.815828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.815977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.816125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.816314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.816463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.816625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.816789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.816939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.817093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.817249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.817397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.817552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.817700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.817859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.818017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.818194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.818513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.818671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.818827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.819002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.819239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.819413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.819610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.819778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.819935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.819935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.820373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.820540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.820699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.820849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.821009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.821160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.821315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.821457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.821618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.821725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.821818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.821902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.821996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.822069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.822147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.822226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.822467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.822565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.822638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.822708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.822789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.822789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.822789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.823574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.823658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.823762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.823908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.824004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.824090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.824201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.824294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.824294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.824466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.824549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.824649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.824741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.824855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.824958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.825177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.825269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.825494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.825585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.825839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.825928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.826146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.826237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.826469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.826592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.826795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.826913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.827110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.827241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.827420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.827557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.827727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.827878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.828055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:43:03.828223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.828552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.828665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.828875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.828980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.829189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.829299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.829536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.829662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.829952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.830052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.830270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.830378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.830594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.830696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.830908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.831010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.831222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.831313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.831541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.831631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.831854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.831952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.832190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.832297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.832507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.832609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.832830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.832937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.833154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.833254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.833493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.833710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.833817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.834759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.834759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.834932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.835922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.836193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.836302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.836514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.836615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.836868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.837213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.837442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.837533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.837779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.837915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.838117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.838216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.838427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.839164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.839357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.839805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.840196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.840313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.840509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.840626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.840831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.840936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.841159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.841260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.841479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.841586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.841811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.841907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.842127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.842228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.842445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.842543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.844183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.844327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.844415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.844488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.844569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.844719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.844796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.844867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.844938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.845876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.846837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.846940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.847026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.847107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.847179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.847249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.847320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.847399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.847471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.847897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.848005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.848088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.848183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.848274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.848347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.848534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.848649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.848850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.848951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.849196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.849318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.849524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.849611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.849856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.849948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.850170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.850300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.850504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.850595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.850815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.850992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.851188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.851305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.851446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.851546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.851755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.851854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.852084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.852216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.852458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.852574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.852763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.852887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.853107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.853217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.853686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.853808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.853896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.853989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.854187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.854290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.854504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.854585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.854824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.854924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.855171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.855339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.855505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.855660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.855818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.855995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.856164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.856342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.856526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.856659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.856840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.857158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.857255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.857472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.857571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.857789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.857895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.858100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.858200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.858433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.858537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.858746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.858839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.859097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.859195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.859366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.859457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.859679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.859786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.859992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.860083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.860325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.860417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.860640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.860741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.860948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.861045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.861263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.861394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.861580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.861694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.861887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.862003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.862196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.862298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.862530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.862628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.862845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.862943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.863155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.863264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.863491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.863590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.863814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.863913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.864216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.864333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.864485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.864577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.864807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.864907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.865125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.865227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.865448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.865541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.865769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.865860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.866091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.866183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.866434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.866670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.866761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.867016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.867121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.867340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.867432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.867655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.867752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.867973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.868078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.868322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.868449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.868645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.868782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.868966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.869100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.869292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.869435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.869611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.869780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.869960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.870300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.870570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.870669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.870949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.871039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.871292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.871397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.871621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.871725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.871940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.872039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.872287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.872394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.872610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.872701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.872949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.873052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.873275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.873367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.873587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.873686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.873899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.874006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.874217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.874314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.874532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.874623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.874850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.874950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.875201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.875306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.875490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.875588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.875810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.875910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.876129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.876347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.876449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.876541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.876774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.876874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.877100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.877194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.877432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.877524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.877776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.877876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.878105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.878203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.878426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.878525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.878741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.878839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.879061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.879150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.879389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.879587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.879689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.880256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.880382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.880470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.880554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.880787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.880886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.881121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.881225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.881445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.881535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.881774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.881905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.882094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.882206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.882402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.882500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.882717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.882809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.883035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.883126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.883346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.883451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.883655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.883752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.883973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.884083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.884312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.884416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.884629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.884738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.884953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.885048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.885307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.885994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.886254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.886429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.886570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.886783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.886905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.887125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.887232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.887449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.887552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.887783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.887896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.888109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.888220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.888450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.888542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.888786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.888892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.889093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.889191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.889405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.889513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.889731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.889842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.890043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.890135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.891971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.892281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.892386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.892485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.892638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.892770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.892956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.893085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.893274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.893398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.893612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.893711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.893931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.894023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.894250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.894349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.894567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.894670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.894880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.894981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.895196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.895296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.895513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.895615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.896094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.896459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.896579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.896785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.896886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.897108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.897198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.897557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.897666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.897752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.897843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.898060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.898170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.898470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.898575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.898922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.899039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.899140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.899225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.899347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.899449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.899660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.899770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.899977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.900081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.900315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.900419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.900650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.900814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.900965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.901722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.901974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.902147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.902301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.902445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.902618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.902912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.903027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.903226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.903326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.903543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.903639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.904122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.904279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.904464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.904557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.904790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.904889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.905104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.905206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.905416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.905536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.905748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.905842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.906061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.906155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.907520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.907654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.907758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.907845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.907845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.908972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.909072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.909156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.909240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.909326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.909411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.909493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.909583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.909717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.909871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.910042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.910190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.910359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.910592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.910737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.910908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.911050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.911307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.911445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.911672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.911775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.911990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.912083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.912363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.912514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.912692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.912792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.913002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.913096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.913321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.913430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.913627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.913720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.913948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.914073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.914277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.914400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.914594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.914730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.914909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.915035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.915225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.915356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.915541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.915669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.915853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.915977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.917126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.917299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.917425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.917644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.917783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.917921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.918046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.918155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.918273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.918394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.918511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.918632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.918743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.918870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.918992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.919109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.919218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.919333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.919462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.919572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.919700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.919811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.919929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.920045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.920188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.920430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.920648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.920778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.920976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.921101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.921308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.921443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.921631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.921749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.921947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.922064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.922261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.922387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.922613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.922758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.922871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.922985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.923185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.923322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.923495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.923620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.923805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.924114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.924449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.925337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.925337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.925337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.925691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.925958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.926065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.926301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.926393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.926634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.926734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.926944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.927038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.927297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.927398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.927608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.927702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.927963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.928063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.928297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.928391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.928620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.928721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.928948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.929049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.929269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.929367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.929585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.929682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.929912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.930005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.930214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.930315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.930538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.930651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.930851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.930945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.931172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.931270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.931482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.931634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.931793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.931893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.932119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.932368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.932576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.932702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.932849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.932985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.933193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.933288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.933642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.933762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.933864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.933938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.934143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.934236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.934457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.934550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.934773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.934879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.935088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.935188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.935406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.935502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.935779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.935895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.936028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.936176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.936372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.936475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.936692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.936791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.937011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.937115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.937329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.937430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.937643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.937734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.937961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.938064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.938295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.938393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.938614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.938717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.938947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.939052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.939263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.939357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.939576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.939669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.939891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.939991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.940225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.940414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.940561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.940783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.940953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.941084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.941189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.941438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.941656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.941745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.941839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.942014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.942109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.942327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.942427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.942650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.942753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.942972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.943090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.943301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.943406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.943693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.943806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.944006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.944098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.944382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.944475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.944768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.944908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.945099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.945200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.945416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.945508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.945731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.945878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.946056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.946181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.946303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:43:03.946398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.946675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.946988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.947300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.947610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.948477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.948792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.949122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.949638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.949965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.950283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.950712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.951030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.951347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.951679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.952009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.952368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.952712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.953047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.953351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.953685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.954017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.954339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.954659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.955000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.955333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.955664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.955989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.956348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.956772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.957103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.957421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.957751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.958083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.958422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.958732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.959049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.959361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.959672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.960003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.960341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.960663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.960982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.961296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.961626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.961920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.962520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.962833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.963163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.963575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.964531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.965171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.965171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.965477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.965794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.966111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.966423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.966758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.967149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.967462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.967789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.968130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.968490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.968810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.969154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.969489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.969831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.970161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.970491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.970806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.971119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.971436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.971750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.972060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.972405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.972719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.973030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.973347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.973642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.973973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.974286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.974618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.974934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.975248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.975560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.975872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.976258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.976571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.976911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.977228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.977561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.977884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.978236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.978557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.978896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.979295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.979639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.979963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.980309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.980631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.980956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.981275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.981853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.982201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.982525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.982846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.983167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.983494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.983828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.984158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.984489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.984809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.985127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.985464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.985794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.986431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.986784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.987113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.987435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.987945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.988342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.988713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.989059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.989451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.989768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.990099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.990424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.990745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.991064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.991386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.991706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.992031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.992377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.992699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.993018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.993349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.993696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.994023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.994343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.994662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.995038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.995736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.996057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.996428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.996762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.997096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.997421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.997826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.998079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.998397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.998710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.999028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.999344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.999658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:03.999986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.000328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.000641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.000997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.001314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.001940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.002293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.002614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.002948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.003281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.003606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.003922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.004280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.004599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.005116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.005438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.005643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.005958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.006271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.006590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.006929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.007234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.007549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.007859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.008216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.008531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.008842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.009153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.009469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.009759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO dbcounter [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Registered counter for database nova_api Aug 29 22:43:04.009872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.010077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.011035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.011346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.011653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.012426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.012426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.012720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.012960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.013276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.013591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.013950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.014288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.014604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.014914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.015255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.015576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.015890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.016233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.016592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.016908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.017232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.017805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.018166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.018495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.018838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.019175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.019490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.019803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.020115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.020824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.020934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.021183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.021506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.021829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.022145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.022461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.022780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.023098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.023408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.023791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.024150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.024482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.024799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.025114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.025435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.027396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.027396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.027396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.027836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.028084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.028433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.028757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.029078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.029452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.029784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.030136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.030447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.030762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.031204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.031533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.032215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.032539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.032871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.033204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.033540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.033856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.034174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.034514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.034865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.034992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_db.sqlalchemy.engines [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:43:04.035297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.035641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.035959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.036301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.036618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.036938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.037264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.037583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.037982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.038930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.038930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.038930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.039251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.039514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.039825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.040158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.040515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.040839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.041152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.041464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.041888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.042005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writer thread running {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:43:04.042207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.042524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.042836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.043160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.043460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.043772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.044081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.044454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.044799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.045120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.045450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.045770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.046099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.046414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.046787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.047111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.047427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.047745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.048083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.048425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.048742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.049060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.049375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.049692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.050006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.050339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.050670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.050981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.051313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.051642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.052059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.052488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.052812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.053151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.053469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.053789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.054107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.054425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.054744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.055065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.055382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.055698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.056020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.056366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.056704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.057037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.057383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.057718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.058144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.058506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.058829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.059185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.059532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.059844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.060181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.060496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:43:04.060745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:43:04.098952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.context [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ef697b0-8690-4044-8ada-38684217d1b2(cell1) {{(pid=128151) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:43:04.103012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.103489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.105258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.106006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.106461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.108495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.110511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO dbcounter [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Registered counter for database nova_cell0 Aug 29 22:43:04.114562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO dbcounter [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Registered counter for database nova_cell1 Aug 29 22:43:04.122594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_db.sqlalchemy.engines [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:43:04.124557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_db.sqlalchemy.engines [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:43:04.125419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO dbcounter [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Registered counter for database nova_api Aug 29 22:43:04.131597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writer thread running {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:43:04.132915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writer thread running {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:43:04.146500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_db.sqlalchemy.engines [None req-9358d642-6276-46f1-9966-9b86d116156d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:43:04.153264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writer thread running {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:43:04.210816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.context [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7ef697b0-8690-4044-8ada-38684217d1b2(cell1) {{(pid=128150) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:43:04.215647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.216237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.217837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.218655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:43:04.219101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:43:04.221137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:43:04.223135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO dbcounter [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Registered counter for database nova_cell0 Aug 29 22:43:04.227478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO dbcounter [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Registered counter for database nova_cell1 Aug 29 22:43:04.235538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_db.sqlalchemy.engines [None req-9358d642-6276-46f1-9966-9b86d116156d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:43:04.236843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_db.sqlalchemy.engines [None req-9358d642-6276-46f1-9966-9b86d116156d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:43:04.243808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writer thread running {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:43:04.245177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writer thread running {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:43:04.282430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO dbcounter [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Registered counter for database nova_cell0 Aug 29 22:43:04.289258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_db.sqlalchemy.engines [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:43:04.295100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writer thread running {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:43:04.400684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO dbcounter [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Registered counter for database nova_cell0 Aug 29 22:43:04.409214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_db.sqlalchemy.engines [None req-9358d642-6276-46f1-9966-9b86d116156d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:43:04.414083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writer thread running {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:43:04.621452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: WARNING keystonemiddleware.auth_token [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:43:04.628839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: WARNING keystonemiddleware.auth_token [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:43:04.744531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: WARNING keystonemiddleware.auth_token [None req-9358d642-6276-46f1-9966-9b86d116156d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:43:04.753002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: WARNING keystonemiddleware.auth_token [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:43:04.984591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: WARNING keystonemiddleware.auth_token [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:43:04.991835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: WARNING keystonemiddleware.auth_token [None req-e2095ea7-3876-4e21-95cd-ef2071956bfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:43:04.998344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561055a279c0 pid: 128151 (default app) Aug 29 22:43:05.110078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: WARNING keystonemiddleware.auth_token [None req-9358d642-6276-46f1-9966-9b86d116156d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:43:05.116376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: WARNING keystonemiddleware.auth_token [None req-9358d642-6276-46f1-9966-9b86d116156d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:43:05.122185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561055a279c0 pid: 128150 (default app) Aug 29 22:43:43.913175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:43.933581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:43.935551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:43.939021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:45.231533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-22ad96e4-59a0-455b-8b9c-13c54ef101cb tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Action: 'create', calling method: .version_select at 0x7febd612eee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-797793607"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:48.829489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-22ad96e4-59a0-455b-8b9c-13c54ef101cb tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.943115 Aug 29 22:43:48.832014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Mon Aug 29 22:43:43 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4949 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 22:43:48.894990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=3 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:48.897888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=3 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:48.899856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=3 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:48.901982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=3 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:49.810338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5a134c85-fc22-4695-9b48-f295b43d36e3 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd6104a60>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:50.451182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5a134c85-fc22-4695-9b48-f295b43d36e3 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5" status: 200 len: 345 microversion: 2.1 time: 1.591246 Aug 29 22:43:50.452496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1/2] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 22:43:48 2022] GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5 => generated 345 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:50.473557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b28ab9cf-8802-4605-b226-74c0654c69eb tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Action: 'create', calling method: .version_select at 0x7febd5f90ca0>, body: {"snapshot": {"volume_id": "ccc0886a-572c-4678-af03-09f8e45007d5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1740596680"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:51.515355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b28ab9cf-8802-4605-b226-74c0654c69eb tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.048544 Aug 29 22:43:51.516473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 2/3] 10.222.0.59 () {60 vars in 1162 bytes} [Mon Aug 29 22:43:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:51.531871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6b328ece-541e-4ef5-b6e5-0eb46fa296c6 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5fccf70>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:51.623929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6b328ece-541e-4ef5-b6e5-0eb46fa296c6 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8" status: 200 len: 287 microversion: 2.1 time: 0.100683 Aug 29 22:43:51.624527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1251 bytes} [Mon Aug 29 22:43:51 2022] GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8 => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:51.641033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d925fd41-cfc6-4db1-be81-c504712fd066 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5fa6e50>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:52.137446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d925fd41-cfc6-4db1-be81-c504712fd066 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.503738 Aug 29 22:43:52.139016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 3/5] 10.222.0.59 () {58 vars in 1140 bytes} [Mon Aug 29 22:43:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:52.155916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-20589435-635f-4c31-8786-17e78b20553c tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5f8c4c0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:52.199350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-20589435-635f-4c31-8786-17e78b20553c tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8" status: 200 len: 287 microversion: 2.1 time: 0.047317 Aug 29 22:43:52.199959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 3/6] 10.222.0.59 () {58 vars in 1251 bytes} [Mon Aug 29 22:43:52 2022] GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:53.214804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-86cff68f-8317-4099-9bdf-b190cbf4b72f tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5fa6ca0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:53.280552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-86cff68f-8317-4099-9bdf-b190cbf4b72f tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8" status: 200 len: 287 microversion: 2.1 time: 0.071833 Aug 29 22:43:53.281948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1251 bytes} [Mon Aug 29 22:43:53 2022] GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:53.626475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2c814d14-db18-4b26-80ea-2eeb5b4db326 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Action: 'create', calling method: .version_select at 0x7febd5fcc9d0>, body: {"keypair": {"name": "tempest-keypair-1832506780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhdQAcutqEkJSk5wR68ju/IidJs6srWmoAkCGhSWxpnPnCmW3hraJJqfoid8j9FXWsS1cf1hO7HFjyFMm7p8c1za1dR1ARdYUwuYyzSF/JcLZdwLTdiURvI+x35hsdi9Q=="}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:53.814554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-2c814d14-db18-4b26-80ea-2eeb5b4db326 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Getting quotas for project d45f8dd557e14a6483ebe7e39d902641. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:43:53.844966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-2c814d14-db18-4b26-80ea-2eeb5b4db326 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Getting quotas for user 42a287a54c4040ac828ee221a3f2e8c7 and project d45f8dd557e14a6483ebe7e39d902641. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:43:54.146965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2c814d14-db18-4b26-80ea-2eeb5b4db326 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.731177 Aug 29 22:43:54.147617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 4/8] 10.222.0.59 () {62 vars in 1200 bytes} [Mon Aug 29 22:43:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 733 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 22:43:54.296481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7cdc65aa-750d-4e13-926f-7e1bf69c1fa3 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5fa6430>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:54.430980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7cdc65aa-750d-4e13-926f-7e1bf69c1fa3 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8" status: 200 len: 287 microversion: 2.1 time: 0.129903 Aug 29 22:43:54.430980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 5/9] 10.222.0.59 () {58 vars in 1251 bytes} [Mon Aug 29 22:43:54 2022] GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8 => generated 287 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:55.439605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0513986f-0cc4-4f0c-9174-28e003826d71 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5f233a0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:55.524530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0513986f-0cc4-4f0c-9174-28e003826d71 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8" status: 200 len: 288 microversion: 2.1 time: 0.091803 Aug 29 22:43:55.532430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 5/10] 10.222.0.59 () {58 vars in 1251 bytes} [Mon Aug 29 22:43:55 2022] GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8 => generated 288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:55.537168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-da508762-43fe-473f-9f14-6c151d233005 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5f90ee0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:55.807287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-da508762-43fe-473f-9f14-6c151d233005 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8" status: 202 len: 0 microversion: 2.1 time: 0.273774 Aug 29 22:43:55.807287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 6/11] 10.222.0.59 () {58 vars in 1254 bytes} [Mon Aug 29 22:43:55 2022] DELETE /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:43:55.816656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fb62c5f7-6530-40ad-80f9-7071087b5fc2 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5f23a60>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:55.888313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fb62c5f7-6530-40ad-80f9-7071087b5fc2 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8" status: 200 len: 287 microversion: 2.1 time: 0.075399 Aug 29 22:43:55.893263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1251 bytes} [Mon Aug 29 22:43:55 2022] GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:56.906801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8dd2c4a8-acc8-4636-a0dc-b06eb8dfd7ed tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5f90ca0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:56.971407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-8dd2c4a8-acc8-4636-a0dc-b06eb8dfd7ed tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] HTTP exception thrown: Snapshot 71096ae6-cfe3-434f-b0df-4677b1c3dce8 could not be found. Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8dd2c4a8-acc8-4636-a0dc-b06eb8dfd7ed tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Request method failure captured: Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8 HTTP/1.1 Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUEfE93LDfjUH_kUBe40kgHUmJX6_CuJ5K-z7DHXdoBO9iGfItn4eI4xb_cPOIV2t5g2IoSU9FiL24xrz97k4Htw2DJzEhKf-eD_H0aDPP0Jkh5HGiaSoz7At2JHeQFqt-OHABSKhWmsLFvNJZnFHeW4KEfXJypy_dBxq-FaNOoFlEc Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 8ba704574496408d84b349f1c44ecc80 Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 22:43:56.977142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8ba704574496408d84b349f1c44ecc80", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 8ba704574496408d84b349f1c44ecc80 Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesSnapshotsTestJSON-2018480381-project Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 75eb21cb023f482ca5cba476a315a32f Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2018480381-project Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Snapshot 71096ae6-cfe3-434f-b0df-4677b1c3dce8 could not be found. Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '71096ae6-cfe3-434f-b0df-4677b1c3dce8'} Aug 29 22:43:56.978481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 71096ae6-cfe3-434f-b0df-4677b1c3dce8 could not be found. (HTTP 404) (Request-ID: req-067a4e81-c83e-410f-8fbc-9ddf2b1517fc) Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:56.979095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:43:56.980378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 71096ae6-cfe3-434f-b0df-4677b1c3dce8 could not be found. Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 22:43:56.981213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 71096ae6-cfe3-434f-b0df-4677b1c3dce8 could not be found. Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 71096ae6-cfe3-434f-b0df-4677b1c3dce8 could not be found. Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8dd2c4a8-acc8-4636-a0dc-b06eb8dfd7ed tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Returning 404 to user: Snapshot 71096ae6-cfe3-434f-b0df-4677b1c3dce8 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:43:56.982137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8dd2c4a8-acc8-4636-a0dc-b06eb8dfd7ed tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8" status: 404 len: 111 microversion: 2.1 time: 0.081976 Aug 29 22:43:56.983975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1251 bytes} [Mon Aug 29 22:43:56 2022] GET /compute/v2.1/os-snapshots/71096ae6-cfe3-434f-b0df-4677b1c3dce8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:43:56.987663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d7ee6c9a-8b32-453e-b55a-87d081b20db3 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5ef3e50>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:57.336617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d7ee6c9a-8b32-453e-b55a-87d081b20db3 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5" status: 202 len: 0 microversion: 2.1 time: 0.351138 Aug 29 22:43:57.338004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 7/14] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 22:43:56 2022] DELETE /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:43:57.346561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-569ecd95-5be5-442d-8f9c-0c09fee530d4 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd691c3a0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:57.450473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-569ecd95-5be5-442d-8f9c-0c09fee530d4 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5" status: 200 len: 344 microversion: 2.1 time: 0.108102 Aug 29 22:43:57.451492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 8/15] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 22:43:57 2022] GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5 => generated 344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:43:58.468198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-19f97025-2ef5-4af8-9e96-d65173c4803d tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5f238b0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:58.606947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-19f97025-2ef5-4af8-9e96-d65173c4803d tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] HTTP exception thrown: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-19f97025-2ef5-4af8-9e96-d65173c4803d tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Request method failure captured: Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5 HTTP/1.1 Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEfE93LDfjUH_kUBe40kgHUmJX6_CuJ5K-z7DHXdoBO9iGfItn4eI4xb_cPOIV2t5g2IoSU9FiL24xrz97k4Htw2DJzEhKf-eD_H0aDPP0Jkh5HGiaSoz7At2JHeQFqt-OHABSKhWmsLFvNJZnFHeW4KEfXJypy_dBxq-FaNOoFlEc Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 8ba704574496408d84b349f1c44ecc80 Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:43:58.615386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8ba704574496408d84b349f1c44ecc80", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 8ba704574496408d84b349f1c44ecc80 Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-VolumesSnapshotsTestJSON-2018480381-project Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 75eb21cb023f482ca5cba476a315a32f Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2018480381-project Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': 'ccc0886a-572c-4678-af03-09f8e45007d5'} Aug 29 22:43:58.616689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. (HTTP 404) (Request-ID: req-e990f003-bbc1-4376-b096-0e3ce21ca45e) Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:58.617331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:43:58.618361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:43:58.619323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.620371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.622893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-19f97025-2ef5-4af8-9e96-d65173c4803d tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Returning 404 to user: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:43:58.624128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-19f97025-2ef5-4af8-9e96-d65173c4803d tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5" status: 404 len: 109 microversion: 2.1 time: 0.162412 Aug 29 22:43:58.637939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 22:43:58 2022] GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5 => generated 109 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:43:58.651700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-57d9dc9c-a498-480e-8e21-9cc78ec6649c tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5fac790>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:58.753079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-57d9dc9c-a498-480e-8e21-9cc78ec6649c tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] HTTP exception thrown: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-57d9dc9c-a498-480e-8e21-9cc78ec6649c tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Request method failure captured: Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: DELETE /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5 HTTP/1.1 Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUEfE93LDfjUH_kUBe40kgHUmJX6_CuJ5K-z7DHXdoBO9iGfItn4eI4xb_cPOIV2t5g2IoSU9FiL24xrz97k4Htw2DJzEhKf-eD_H0aDPP0Jkh5HGiaSoz7At2JHeQFqt-OHABSKhWmsLFvNJZnFHeW4KEfXJypy_dBxq-FaNOoFlEc Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 8ba704574496408d84b349f1c44ecc80 Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 22:43:58.756692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8ba704574496408d84b349f1c44ecc80", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 8ba704574496408d84b349f1c44ecc80 Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesSnapshotsTestJSON-2018480381-project Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 75eb21cb023f482ca5cba476a315a32f Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2018480381-project Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': 'ccc0886a-572c-4678-af03-09f8e45007d5'} Aug 29 22:43:58.758677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. (HTTP 404) (Request-ID: req-44c7dda7-651f-42ed-ace6-27fc431bbe37) Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:58.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:43:58.766140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 22:43:58.768101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-57d9dc9c-a498-480e-8e21-9cc78ec6649c tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Returning 404 to user: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-57d9dc9c-a498-480e-8e21-9cc78ec6649c tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5" status: 404 len: 109 microversion: 2.1 time: 0.112476 Aug 29 22:43:58.773110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 9/17] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 22:43:58 2022] DELETE /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:43:58.779805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-898fb767-42e2-44be-8767-df12c0f31619 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Calling method '.version_select at 0x7febd5e83940>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:58.830213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-898fb767-42e2-44be-8767-df12c0f31619 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] HTTP exception thrown: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-898fb767-42e2-44be-8767-df12c0f31619 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Request method failure captured: Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5 HTTP/1.1 Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEfE93LDfjUH_kUBe40kgHUmJX6_CuJ5K-z7DHXdoBO9iGfItn4eI4xb_cPOIV2t5g2IoSU9FiL24xrz97k4Htw2DJzEhKf-eD_H0aDPP0Jkh5HGiaSoz7At2JHeQFqt-OHABSKhWmsLFvNJZnFHeW4KEfXJypy_dBxq-FaNOoFlEc Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 8ba704574496408d84b349f1c44ecc80 Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:43:58.835038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8ba704574496408d84b349f1c44ecc80", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8ba704574496408d84b349f1c44ecc80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 8ba704574496408d84b349f1c44ecc80 Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2018480381 Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-VolumesSnapshotsTestJSON-2018480381-project Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 75eb21cb023f482ca5cba476a315a32f Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2018480381-project Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': 'ccc0886a-572c-4678-af03-09f8e45007d5'} Aug 29 22:43:58.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. (HTTP 404) (Request-ID: req-8f1ed215-22e0-4ad0-b7ea-c008cb5d6d8f) Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:58.838432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:43:58.839350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:43:58.840316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-898fb767-42e2-44be-8767-df12c0f31619 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] Returning 404 to user: Volume ccc0886a-572c-4678-af03-09f8e45007d5 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-898fb767-42e2-44be-8767-df12c0f31619 tempest-VolumesSnapshotsTestJSON-2018480381 tempest-VolumesSnapshotsTestJSON-2018480381-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5" status: 404 len: 109 microversion: 2.1 time: 0.076687 Aug 29 22:43:58.842319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 9/18] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 22:43:58 2022] GET /compute/v2.1/os-volumes/ccc0886a-572c-4678-af03-09f8e45007d5 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:43:59.367528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1b03a121-ceb7-48e7-9f2f-8a032a1fe196 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Action: 'create', calling method: .version_select at 0x7febd5f214c0>, body: {"keypair": {"name": "tempest-keypair-327097771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoAHFcqlllHVzk9yHuiZ4O7KF91T/voeSADwTLqEnmHyIE2ru88hmbjN8zDcPmxOfemZqEllGMkQz5DCR+XWIT+FF+XaQ7Hv7GXmxVFeSES1x0QnUVy9gThM2FtgC1t9Q=="}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:43:59.483587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-1b03a121-ceb7-48e7-9f2f-8a032a1fe196 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Getting quotas for project df7ab727f89e4fcb9933c2098b4fb501. Resources: {'key_pairs'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:43:59.505012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-1b03a121-ceb7-48e7-9f2f-8a032a1fe196 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Getting quotas for user 43cdaa09925c4b00be3b45cea4fd40b7 and project df7ab727f89e4fcb9933c2098b4fb501. Resources: {'key_pairs'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:43:59.740286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1b03a121-ceb7-48e7-9f2f-8a032a1fe196 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.890281 Aug 29 22:43:59.740931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 10/19] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 22:43:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:01.721212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1653778057", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9551621c-c4f2-4297-ad29-3abc9d72be15"}], "security_groups": [{"name": "tempest-securitygroup--2021348853"}], "key_name": "tempest-keypair-1832506780", "user_data": "}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:02.008085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-853774452", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:02.166512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.network.neutron [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] validate_networks() for [('9551621c-c4f2-4297-ad29-3abc9d72be15', None, None, None, None, None)] {{(pid=128151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:44:02.193637 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] validate_networks() for [('59f87ade-84a8-48d6-afc0-e65ac06d9bed', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:44:03.888222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=4 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:04.212905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:44:04.213529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:44:04.214130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:44:04.215112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:44:04.216341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:44:04.227574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:04.228052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:04.228533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:04.229434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:04.229882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:04.230463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:04.256626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Getting quotas for project 66de012537ed40e3bc233b80458bcfc4. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:04.262846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Getting quotas for user cc2f5c40aedf47dcb6374d64fcb04add and project 66de012537ed40e3bc233b80458bcfc4. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:04.287617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Flavor limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:44:04.289352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Image limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:44:04.293255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Flavor pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:44:04.296452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Image pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:44:04.297630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:44:04.304496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:44:04.318481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:44:04.330980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:04.331614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:04.332361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:04.334295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:04.335875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:04.336478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:04.372014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Getting quotas for project d45f8dd557e14a6483ebe7e39d902641. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:04.378136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Getting quotas for user 42a287a54c4040ac828ee221a3f2e8c7 and project d45f8dd557e14a6483ebe7e39d902641. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:04.395744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Going to run 1 instances... {{(pid=128151) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:44:04.399969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:44:04.578329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac4c388d-9d04-434b-bdf5-7dae692be4f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.861271 Aug 29 22:44:04.589781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 11/20] 10.222.0.59 () {62 vars in 1188 bytes} [Mon Aug 29 22:44:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2869 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 22:44:04.594814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b1e89f99-3a59-4d75-bb76-3ede0796346b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.075801 Aug 29 22:44:04.602838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 10/21] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:44:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:44:04.602838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1ee9ab22-cbf3-480f-a37f-005c2f480df6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:04.610409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1ee9ab22-cbf3-480f-a37f-005c2f480df6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:04.799289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1ee9ab22-cbf3-480f-a37f-005c2f480df6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:04.843815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1ee9ab22-cbf3-480f-a37f-005c2f480df6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:04.846302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1ee9ab22-cbf3-480f-a37f-005c2f480df6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:04.847445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1ee9ab22-cbf3-480f-a37f-005c2f480df6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1282 microversion: 2.20 time: 0.250298 Aug 29 22:44:04.848013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 11/22] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1282 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:04.856207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-155d8072-dfde-415a-8ab5-6c58eac9b14d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:04.862536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-155d8072-dfde-415a-8ab5-6c58eac9b14d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:04.942856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-155d8072-dfde-415a-8ab5-6c58eac9b14d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:04.950778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-155d8072-dfde-415a-8ab5-6c58eac9b14d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1221 microversion: 2.1 time: 0.101705 Aug 29 22:44:04.964245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 12/23] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:04 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1221 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:04.964245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1482537092", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e68f004d-6141-4239-8019-0a6bfb114017"}], "security_groups": [{"name": "tempest-securitygroup--1600226236"}], "key_name": "tempest-keypair-327097771", "user_data": "}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:05.094939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-568762015", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "networks": [{"uuid": "36e534e2-240e-4807-8fab-e470ff1ca6f7"}]}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:05.125789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] validate_networks() for [('e68f004d-6141-4239-8019-0a6bfb114017', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:44:05.217012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.network.neutron [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] validate_networks() for [('36e534e2-240e-4807-8fab-e470ff1ca6f7', None, None, None, None, None)] {{(pid=128151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:44:05.963281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:44:05.963794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:44:05.964291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:44:05.964714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:44:05.965128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:44:05.982851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:05.983345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:05.983781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:05.987804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:05.988268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:05.992374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:06.037474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Getting quotas for project df7ab727f89e4fcb9933c2098b4fb501. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:06.048510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Getting quotas for user 43cdaa09925c4b00be3b45cea4fd40b7 and project df7ab727f89e4fcb9933c2098b4fb501. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:06.060851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Flavor limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:44:06.063699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Image limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:44:06.063699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Flavor pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:44:06.063699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Image pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:44:06.063699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:44:06.083109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:06.085447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:06.087318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:06.090442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:06.092841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:06.093586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:06.100458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:44:06.110852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:44:06.135053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Getting quotas for project 844009bb229a4357bb183c22473ec045. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:06.153013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Getting quotas for user b21dc8a79bce4b26a690d8990c52116c and project 844009bb229a4357bb183c22473ec045. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:06.164610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Going to run 1 instances... {{(pid=128151) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:44:06.167068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:44:06.362583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-93fc6df4-f364-4801-9447-9e30e2a23394 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.409621 Aug 29 22:44:06.370101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 13/24] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:44:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:44:06.371194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a718ce02-a098-48ed-9c0f-62f689da29fc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.777825 Aug 29 22:44:06.371845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 12/25] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:44:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:44:06.376368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-837073568", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:06.405712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8f799d8f-c08d-4b4f-874b-de5a5176b9e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:06.406329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8f799d8f-c08d-4b4f-874b-de5a5176b9e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:06.442805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] validate_networks() for [('59f87ade-84a8-48d6-afc0-e65ac06d9bed', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:44:06.551846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f799d8f-c08d-4b4f-874b-de5a5176b9e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:06.571745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f799d8f-c08d-4b4f-874b-de5a5176b9e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:06.573829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f799d8f-c08d-4b4f-874b-de5a5176b9e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:06.575402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8f799d8f-c08d-4b4f-874b-de5a5176b9e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1282 microversion: 2.20 time: 0.195676 Aug 29 22:44:06.576701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 13/26] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:07.377691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:44:07.378281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:44:07.379368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:44:07.379838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:44:07.380350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:44:07.391156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:07.391782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:07.392372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:07.393242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:07.393978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:07.394617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:07.419436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Getting quotas for project 66de012537ed40e3bc233b80458bcfc4. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:44:07.424411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Getting quotas for user cc2f5c40aedf47dcb6374d64fcb04add and project 66de012537ed40e3bc233b80458bcfc4. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:44:07.439408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:44:07.442993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:44:07.464778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-080ab939-f0b7-464f-9843-45df396fa4a3 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] Action: 'create', calling method: .version_select at 0x7febd5582a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1230947569", "metadata": {"Type": "work"}}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:07.728985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-312d2eba-2a33-447f-adbd-7e201640e895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.357363 Aug 29 22:44:07.740304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 14/27] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:44:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:44:07.760707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-585790f4-69aa-4e9f-bc59-7a5a31529e88 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:07.765728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-585790f4-69aa-4e9f-bc59-7a5a31529e88 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:07.974581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-585790f4-69aa-4e9f-bc59-7a5a31529e88 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:07.982605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-585790f4-69aa-4e9f-bc59-7a5a31529e88 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1237 microversion: 2.1 time: 0.239912 Aug 29 22:44:07.986664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 15/28] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:07 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1237 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:08.001252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5fc88c14-3c4b-4865-a43f-317d50f6e56e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:08.003366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5fc88c14-3c4b-4865-a43f-317d50f6e56e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:08.122819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5fc88c14-3c4b-4865-a43f-317d50f6e56e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:08.132804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5fc88c14-3c4b-4865-a43f-317d50f6e56e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1214 microversion: 2.1 time: 0.141977 Aug 29 22:44:08.141256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 16/29] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:07 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:08.157537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f610164a-d30d-41bf-88a9-34b86e234aa2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:08.158303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f610164a-d30d-41bf-88a9-34b86e234aa2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:08.249711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f610164a-d30d-41bf-88a9-34b86e234aa2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:08.262924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f610164a-d30d-41bf-88a9-34b86e234aa2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:08.266461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f610164a-d30d-41bf-88a9-34b86e234aa2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:08.270869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f610164a-d30d-41bf-88a9-34b86e234aa2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1282 microversion: 2.20 time: 0.128596 Aug 29 22:44:08.289092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 17/30] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:08.298953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bb5c486d-d6b5-4ccf-9cc5-98c4712a7e1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:08.306449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bb5c486d-d6b5-4ccf-9cc5-98c4712a7e1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:08.396030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bb5c486d-d6b5-4ccf-9cc5-98c4712a7e1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:08.407397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bb5c486d-d6b5-4ccf-9cc5-98c4712a7e1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1221 microversion: 2.1 time: 0.124383 Aug 29 22:44:08.412187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 18/31] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:08 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:09.008644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fca3953a-d4c1-4fbf-b818-fe2c7d196d3f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:09.009278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fca3953a-d4c1-4fbf-b818-fe2c7d196d3f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:09.168937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-080ab939-f0b7-464f-9843-45df396fa4a3 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.591091 Aug 29 22:44:09.170134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 14/32] 10.222.0.59 () {60 vars in 1156 bytes} [Mon Aug 29 22:44:06 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2593 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 22:44:09.176852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:09.177655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:09.181410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fca3953a-d4c1-4fbf-b818-fe2c7d196d3f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.197219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.198244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fca3953a-d4c1-4fbf-b818-fe2c7d196d3f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1237 microversion: 2.1 time: 0.190919 Aug 29 22:44:09.199301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.200568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 19/33] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:09 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1237 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:09.201377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.202962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.205325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.206023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.211495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-894d9252-f21c-49ef-aa58-9909b982a631 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] Calling method '.version_select at 0x7febd5ddf430>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:09.287370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-894d9252-f21c-49ef-aa58-9909b982a631 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b" status: 200 len: 353 microversion: 2.1 time: 0.083725 Aug 29 22:44:09.288099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 20/34] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 22:44:09 2022] GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:09.298716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:09.299367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:09.308016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.308901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.309594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.310470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.311602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.312094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.387736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.402395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-23d1512a-f7b1-4282-b34c-2661992e0552 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1218 microversion: 2.1 time: 0.231104 Aug 29 22:44:09.403326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 15/35] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:09 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1218 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:09.432329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:09.433342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:09.441332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.442169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.443508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.445387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:09.446040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:09.446682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:09.573380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.581057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.585523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-68a1ea7c-4952-4759-883a-60c8364d2333 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1225 microversion: 2.1 time: 0.161075 Aug 29 22:44:09.586930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 16/36] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:09 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1225 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:09.593845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.596769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:09.598711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b00e8351-0bc3-4f33-86ba-ddd5c911f715 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1286 microversion: 2.20 time: 0.304307 Aug 29 22:44:09.599958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 21/37] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1286 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:10.224811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.226323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:10.249628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.249628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.249628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.249628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.250486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.250486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.301506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-edb1f060-1a83-42d3-8d01-45f0ab8b543e tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] Calling method '.version_select at 0x7febd5564d30>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.369735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.379310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4e57a683-ee6b-4316-aa23-5c450128d269 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1241 microversion: 2.1 time: 0.160066 Aug 29 22:44:10.380498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 17/38] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:10 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1241 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:10.424862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.425674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:10.435770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.437874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.438536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.439741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.440400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.441014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.450799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-edb1f060-1a83-42d3-8d01-45f0ab8b543e tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b" status: 200 len: 354 microversion: 2.1 time: 0.153321 Aug 29 22:44:10.451377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 22/39] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 22:44:10 2022] GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:44:10.465467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-54d10cca-a217-41ac-815b-d6518746fd8c tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] Calling method '.version_select at 0x7febd5564e50>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.604776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-54d10cca-a217-41ac-815b-d6518746fd8c tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b" status: 200 len: 354 microversion: 2.1 time: 0.143706 Aug 29 22:44:10.617022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 23/40] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 22:44:10 2022] GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:10.624990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.625909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:10.634060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.634785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.635470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.636543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.637651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.642746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.646271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.655031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-648ebb40-24a3-42ec-bca8-62c8ab601031 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1266 microversion: 2.1 time: 0.234403 Aug 29 22:44:10.672693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 18/41] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:10 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:10.683558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.686708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:10.701926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.702150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.703718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.706610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:10.708977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:10.710052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:10.795229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.804691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7961440c-c18f-4bef-bc65-d5d630b07431 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1217 microversion: 2.1 time: 0.183486 Aug 29 22:44:10.806019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 24/42] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:10 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:10.811148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b122e347-f7d6-4df8-82ab-4b3b937cdfb6 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] Calling method '.version_select at 0x7febd5564a60>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:10.863716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.874916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.876865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:10.878680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c6595b7e-c07a-4caa-bee2-beaf454984d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1334 microversion: 2.20 time: 0.203897 Aug 29 22:44:10.879691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 19/43] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1334 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:11.037159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b122e347-f7d6-4df8-82ab-4b3b937cdfb6 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b" status: 202 len: 0 microversion: 2.1 time: 0.229485 Aug 29 22:44:11.038297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 25/44] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 22:44:10 2022] DELETE /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:44:11.046398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-58430a34-9c89-4cf4-afe7-440b7496bafa tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] Calling method '.version_select at 0x7febd54e6ca0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:11.102415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-58430a34-9c89-4cf4-afe7-440b7496bafa tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b" status: 200 len: 353 microversion: 2.1 time: 0.059829 Aug 29 22:44:11.103001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 20/45] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 22:44:11 2022] GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:11.402107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:11.402719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:11.409283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.409942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.410459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.411269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.412017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.412547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.561920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:11.570292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e7b9f848-a2d1-4eb7-b1c8-5dcbc3df1723 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1289 microversion: 2.1 time: 0.171766 Aug 29 22:44:11.571344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 26/46] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:11 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1289 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:11.684492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:11.685982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:11.693575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.693575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.695694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.696572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.697317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.697839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.810301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:11.823739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d311bd32-d7d6-4f0e-92af-f75d831e5723 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1274 microversion: 2.1 time: 0.145802 Aug 29 22:44:11.828462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:11.829138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:11.843790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 21/47] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:11 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:11.866874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.868412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.869327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.874324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.875222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.878281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.909791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:11.911566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:11.950269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.951146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.953443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:11.964112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:11.964112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:11.964112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:12.085753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:12.097446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3f9e3e15-59a5-49bc-9cf3-e8a768a9e806 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1273 microversion: 2.1 time: 0.274080 Aug 29 22:44:12.100024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 27/48] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:11 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:12.128826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-951c00a9-e8a9-4609-9ecb-abe82efb48f1 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] Calling method '.version_select at 0x7febd54c2e50>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:12.157426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:12.170098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:12.177476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:12.180693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-951c00a9-e8a9-4609-9ecb-abe82efb48f1 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] HTTP exception thrown: Volume 93587da4-04b7-46b5-82a3-8c1e1f48432b could not be found. Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-951c00a9-e8a9-4609-9ecb-abe82efb48f1 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] Request method failure captured: Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b HTTP/1.1 Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUE14vyp7A3Xb-cuYmC6Mjv73A-aRoyybfgD8YCBQOvQmiGr70x90IjRYJhH9UfCcMw1ynonyQJD1rmgT8t9idJ6WYmr0L9WymbpO0eOcFTwVu1HCr-kC6FVu2UZO9LccwejlXv-UYmwhZys8tPsqIBkkwmQw_kkitiftLFppf1RIOs Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: ffd51e41f76e4ff0a89de9365049e149 Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-VolumesGetTestJSON-844912385 Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:44:12.183081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ffd51e41f76e4ff0a89de9365049e149"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ffd51e41f76e4ff0a89de9365049e149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ffd51e41f76e4ff0a89de9365049e149", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ffd51e41f76e4ff0a89de9365049e149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-VolumesGetTestJSON-844912385 Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: ffd51e41f76e4ff0a89de9365049e149 Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-VolumesGetTestJSON-844912385 Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-VolumesGetTestJSON-844912385-project Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 5a454af87e5f427487019b237aab286b Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-VolumesGetTestJSON-844912385-project Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Volume 93587da4-04b7-46b5-82a3-8c1e1f48432b could not be found. Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '93587da4-04b7-46b5-82a3-8c1e1f48432b'} Aug 29 22:44:12.187131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93587da4-04b7-46b5-82a3-8c1e1f48432b could not be found. (HTTP 404) (Request-ID: req-58f70a96-7661-4934-927f-146098e6cd69) Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:12.188064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:44:12.189363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93587da4-04b7-46b5-82a3-8c1e1f48432b could not be found. Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:44:12.190410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93587da4-04b7-46b5-82a3-8c1e1f48432b could not be found. Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93587da4-04b7-46b5-82a3-8c1e1f48432b could not be found. Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-951c00a9-e8a9-4609-9ecb-abe82efb48f1 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] Returning 404 to user: Volume 93587da4-04b7-46b5-82a3-8c1e1f48432b could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-951c00a9-e8a9-4609-9ecb-abe82efb48f1 tempest-VolumesGetTestJSON-844912385 tempest-VolumesGetTestJSON-844912385-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b" status: 404 len: 109 microversion: 2.1 time: 0.072264 Aug 29 22:44:12.193120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 28/49] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 22:44:12 2022] GET /compute/v2.1/os-volumes/93587da4-04b7-46b5-82a3-8c1e1f48432b => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:44:12.194089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9ee1526b-2acc-43cd-a6d7-57b41de6f6d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1342 microversion: 2.20 time: 0.285030 Aug 29 22:44:12.202876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 22/50] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1342 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:12.604861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:12.605880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:12.615743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:12.629121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:12.639449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:12.640156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:12.641518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:12.642205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:12.642875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:12.776933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:12.786189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-785bc9c1-dc5e-46bc-9c21-fc09130292b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1297 microversion: 2.1 time: 0.188505 Aug 29 22:44:12.787070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 29/51] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:12 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1297 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:12.860487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:12.861531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:12.872564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:12.873431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:12.874142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:12.875294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:12.876273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:12.877044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.003243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.021820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4ed3cd1f-48b7-48ba-9903-31ae26798184 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1284 microversion: 2.1 time: 0.168103 Aug 29 22:44:13.022589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 23/52] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:12 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:13.121971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:13.123093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:13.130535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.131222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.132784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.133737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.134344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.134919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.218975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.221193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:13.222432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:13.229470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.230192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.230774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.231631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.231997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0c72a911-2c57-4073-a5cc-5b185099f38d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1273 microversion: 2.1 time: 0.113955 Aug 29 22:44:13.232322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.232759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.233157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 30/53] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:13 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:13.321732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.330926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.332429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.333579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4d90e6c9-3707-4ba6-ad3f-596ba4033422 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1352 microversion: 2.20 time: 0.122146 Aug 29 22:44:13.334405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 24/54] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:13.830029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:13.830945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:13.853857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.854750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.855400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.856226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:13.856777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:13.857269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:13.966420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:13.982815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2117e9de-796c-416a-8ea9-f71520c2e968 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1297 microversion: 2.1 time: 0.161133 Aug 29 22:44:13.984452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 31/55] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:13 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1297 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:14.044775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:14.045899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:14.061917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.062413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.062848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.063550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.064004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.064460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.255099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:14.255757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:14.264983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.265483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.265930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.267161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.267911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.268612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.275375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:14.283943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5ca8d83a-d74b-4cf2-8613-f6c6055254c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1326 microversion: 2.1 time: 0.242783 Aug 29 22:44:14.284568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 25/56] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:14 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1326 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:14.350229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:14.359306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b85bb662-e97e-477e-9a33-d404d6146e5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1273 microversion: 2.1 time: 0.109416 Aug 29 22:44:14.359885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:14.361182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:14.363841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 32/57] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:14 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:14.368478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.369145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.370624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.370624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:14.370624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:14.371123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:14.445530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:14.452421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:14.455217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:14.456357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-11590a88-c4f4-42a5-b32e-a9b1984d8c5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1352 microversion: 2.20 time: 0.101360 Aug 29 22:44:14.457070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 26/58] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:15.008045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:15.008683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:15.015062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.015646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.016071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.016887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.017335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.017747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.097004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:15.109284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e92418af-f420-4917-bae4-cd7a8de50d4e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1297 microversion: 2.1 time: 0.105683 Aug 29 22:44:15.110037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 33/59] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:15 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:15.311018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:15.312621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:15.323469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.324420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.331381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.331381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.331739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.332803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.390568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:15.391921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:15.416865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.417959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.419143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.421101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.432227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.435234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.727605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:15.737462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-23239b3f-9906-4128-b605-8250ddff7a47 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1281 microversion: 2.1 time: 0.357393 Aug 29 22:44:15.747199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 34/60] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:15 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1281 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:15.756877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:15.757723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:15.766282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.770352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.771013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:15.772012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:15.773545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:15.776228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.034629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.039128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.048235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.049562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b688d26d-89b1-4659-a3eb-0e8f896691ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1340 microversion: 2.20 time: 0.301127 Aug 29 22:44:16.050567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 35/61] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1340 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:16.118283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=4 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:16.132894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:16.133629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:16.150671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.152471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.155221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.158072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.158735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.160779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.425099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.430812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.444952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-51e5ff3e-7dd8-4203-9140-499467b6f5ab tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1295 microversion: 2.1 time: 0.316515 Aug 29 22:44:16.449297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3418cfb2-eb4e-47fb-81e9-a83bd1ad9ad8 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1326 microversion: 2.1 time: 1.147029 Aug 29 22:44:16.449934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 27/62] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:15 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1326 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:16.453338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 36/63] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:16 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1295 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:16.765487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:16.766113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:16.770898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=18 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:16.790255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.791992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.792467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.794935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:16.796356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:16.798897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:16.971071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:16.982092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-20900a78-3670-48ef-8b07-5e8e77d6d8c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1279 microversion: 2.1 time: 0.222069 Aug 29 22:44:16.986507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 28/64] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:16 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:17.078930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:17.079779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.088325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.088652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.089264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.090039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.091519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.092297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.403502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=6 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:17.471016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:17.471628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.486269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.495976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.495976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.495976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.495976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.496755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.651376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:17.659539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:17.673363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:17.677232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:17.677732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aa826dab-b4bd-4720-b042-e230340fecca tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1295 microversion: 2.1 time: 0.214621 Aug 29 22:44:17.681927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 29/65] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:17 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1295 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:17.695071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:17.695933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:17.702162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-33f21c8d-bb68-4a1e-a381-1e77554b0c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.627170 Aug 29 22:44:17.706962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 37/66] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:17.737492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.737492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.737492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:17.737492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:17.738024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:17.739372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.015352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:18.016628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:18.030023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.031703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.040619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.044065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.044802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.045464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.234200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.252753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b0c60a5c-737d-4b6e-b1ee-49282fadaefe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1279 microversion: 2.1 time: 0.240577 Aug 29 22:44:18.265287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 38/67] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:18 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1279 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:18.293846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.314500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-54529bbc-1da9-4ce3-ba03-1fd779ec540a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.623227 Aug 29 22:44:18.314500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 30/68] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:17 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:18.706367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:18.706979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:18.713888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.717477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.717477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.717477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.717477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.717839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.741990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:18.743819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:18.752641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.757080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.802374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.802374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:18.802374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:18.802374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:18.860191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:18.860191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7d0f0b0f-760d-4714-afba-4c3a636eda1e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1295 microversion: 2.1 time: 0.155599 Aug 29 22:44:18.860191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 39/69] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:18 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1295 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:19.110583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.128768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:19.147198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.159011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:19.167510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c07f911b-8589-4b2c-afc4-6a0337da41db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.425126 Aug 29 22:44:19.170130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 31/70] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:19.280938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:19.282749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:19.312707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=32 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:19.314893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.315382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.315882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.316561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:19.322075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:19.322527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:19.389111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:19.998453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-fd7e7bb4-9df0-4be1-9fdb-c50efc7149bf req-3e26f010-490b-4a2b-8f36-be68aeeef7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83eb8498-b123-45ae-81b5-a88bbe88cdaa", "tag": "3804445f-c321-4f1d-b09a-eb5a16ac3375"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:20.054708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fd7e7bb4-9df0-4be1-9fdb-c50efc7149bf req-3e26f010-490b-4a2b-8f36-be68aeeef7d4 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.055430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fd7e7bb4-9df0-4be1-9fdb-c50efc7149bf req-3e26f010-490b-4a2b-8f36-be68aeeef7d4 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.056678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fd7e7bb4-9df0-4be1-9fdb-c50efc7149bf req-3e26f010-490b-4a2b-8f36-be68aeeef7d4 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.165343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-fd7e7bb4-9df0-4be1-9fdb-c50efc7149bf req-3e26f010-490b-4a2b-8f36-be68aeeef7d4 service nova] Creating event network-changed:3804445f-c321-4f1d-b09a-eb5a16ac3375 for instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa on hv-cinder-85426 Aug 29 22:44:20.169132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fd7e7bb4-9df0-4be1-9fdb-c50efc7149bf req-3e26f010-490b-4a2b-8f36-be68aeeef7d4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 22:44:20.172786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fd7e7bb4-9df0-4be1-9fdb-c50efc7149bf req-3e26f010-490b-4a2b-8f36-be68aeeef7d4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 22:44:20.175087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64567b08-d3c1-4530-a586-779af7c67df9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.176542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64567b08-d3c1-4530-a586-779af7c67df9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.181082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64567b08-d3c1-4530-a586-779af7c67df9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.182860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64567b08-d3c1-4530-a586-779af7c67df9 None None] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.184803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64567b08-d3c1-4530-a586-779af7c67df9 None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.188286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64567b08-d3c1-4530-a586-779af7c67df9 None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.229388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.compute.rpcapi [None req-64567b08-d3c1-4530-a586-779af7c67df9 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 22:44:20.233376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64567b08-d3c1-4530-a586-779af7c67df9 None None] Releasing lock "compute-rpcapi-router" {{(pid=128151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 22:44:20.264667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-64567b08-d3c1-4530-a586-779af7c67df9 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.805327 Aug 29 22:44:20.266661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 32/71] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:20.279560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:20.280697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:20.291636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.292464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.293130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.294358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.295038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.295682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.602118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:20.610896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3ae9a264-f442-4e68-8e92-6cee001caa84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 1.337183 Aug 29 22:44:20.620397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 40/72] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:19 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:20.627421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:20.628088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:20.648498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.649791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.650625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.654365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:20.655167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:20.655939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:20.962955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:20.984109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-afcd49cd-e6f8-4711-ab92-96e680bf7286 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.714864 Aug 29 22:44:20.985390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 33/73] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:20 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:21.000806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:21.005367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:21.025744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.026768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.027203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.029024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.029776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.034358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.257044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:21.285452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-07ef1e5b-0337-4385-9582-96b8b80a323f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.667081 Aug 29 22:44:21.290486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 41/74] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:20 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:21.368742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:21.385214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:21.387501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:21.390845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e6a5aa1a-bdc7-4ea5-86f8-c14568ed9fe8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.403640 Aug 29 22:44:21.392737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 34/75] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:21.411289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-9ccb792f-5c2b-4c06-9285-869979a1d336 req-765d7a9e-a788-4a45-b6bc-c758c58ad45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e568957-b28a-4d75-b458-3f8e95bb38d0", "tag": "2eaca61c-9e3d-41ec-b39b-74fe4d54599d"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:21.427256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9ccb792f-5c2b-4c06-9285-869979a1d336 req-765d7a9e-a788-4a45-b6bc-c758c58ad45a service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.428045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9ccb792f-5c2b-4c06-9285-869979a1d336 req-765d7a9e-a788-4a45-b6bc-c758c58ad45a service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.428708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9ccb792f-5c2b-4c06-9285-869979a1d336 req-765d7a9e-a788-4a45-b6bc-c758c58ad45a service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.461658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-9ccb792f-5c2b-4c06-9285-869979a1d336 req-765d7a9e-a788-4a45-b6bc-c758c58ad45a service nova] Creating event network-changed:2eaca61c-9e3d-41ec-b39b-74fe4d54599d for instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 on hv-cinder-85426 Aug 29 22:44:21.465289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9ccb792f-5c2b-4c06-9285-869979a1d336 req-765d7a9e-a788-4a45-b6bc-c758c58ad45a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128150) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 22:44:21.465289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9ccb792f-5c2b-4c06-9285-869979a1d336 req-765d7a9e-a788-4a45-b6bc-c758c58ad45a service nova] Acquired lock "compute-rpcapi-router" {{(pid=128150) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 22:44:21.465289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6857e8-6447-44bd-a6bc-038ae7ea9944 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.465289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6857e8-6447-44bd-a6bc-038ae7ea9944 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.465289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6857e8-6447-44bd-a6bc-038ae7ea9944 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.465692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6857e8-6447-44bd-a6bc-038ae7ea9944 None None] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.466670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6857e8-6447-44bd-a6bc-038ae7ea9944 None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.467269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6857e8-6447-44bd-a6bc-038ae7ea9944 None None] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.479139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.compute.rpcapi [None req-2c6857e8-6447-44bd-a6bc-038ae7ea9944 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 22:44:21.480536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6857e8-6447-44bd-a6bc-038ae7ea9944 None None] Releasing lock "compute-rpcapi-router" {{(pid=128150) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 22:44:21.498536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2c6857e8-6447-44bd-a6bc-038ae7ea9944 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206557 Aug 29 22:44:21.500113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 42/76] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:21.645250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:21.646151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:21.654666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.656717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.665193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:21.666275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:21.669526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:21.670147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.007293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:22.008318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:22.022591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.023322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.024221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.028091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.028748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.029331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.225377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.242662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a6700557-7ca2-43e8-ba9c-92e2f7f8246e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.608487 Aug 29 22:44:22.247548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 35/77] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:21 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:22.325416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:22.328895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:22.349860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.357268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.357268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.357268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.357268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.357994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.619266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.628036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9f49b6ad-9ed9-4529-8202-785adc3a62e6 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.625529 Aug 29 22:44:22.638695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 43/78] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:22 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:22.648825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:22.649520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:22.659872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.660453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.661131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.662279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:22.662973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:22.663620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:22.696052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:22.704299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c6965e6c-0267-4d46-ba3a-b9579594e045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.395721 Aug 29 22:44:22.706983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 36/79] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:22 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:23.215162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:23.225739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:23.228393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:23.229695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5a2bd76d-8c0d-4d59-84a7-0d49b41a1468 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.596906 Aug 29 22:44:23.230486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 44/80] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:23.282674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:23.282674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:23.315598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.318046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.321875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.322815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.323300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.323842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.503746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-e3500f0c-c422-467f-bc3e-8e7e9b4e8e09 req-86be5f96-721e-48e4-8817-61e666a7075c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91aa52d5-e323-47c3-b4ea-6f4391575689", "tag": "6be4ff40-5348-4f0a-b930-dd182b22d3a4"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:23.557330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-e3500f0c-c422-467f-bc3e-8e7e9b4e8e09 req-86be5f96-721e-48e4-8817-61e666a7075c service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.562346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-e3500f0c-c422-467f-bc3e-8e7e9b4e8e09 req-86be5f96-721e-48e4-8817-61e666a7075c service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.569862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-e3500f0c-c422-467f-bc3e-8e7e9b4e8e09 req-86be5f96-721e-48e4-8817-61e666a7075c service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.655159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-e3500f0c-c422-467f-bc3e-8e7e9b4e8e09 req-86be5f96-721e-48e4-8817-61e666a7075c service nova] Creating event network-changed:6be4ff40-5348-4f0a-b930-dd182b22d3a4 for instance 91aa52d5-e323-47c3-b4ea-6f4391575689 on hv-cinder-85426 Aug 29 22:44:23.671771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-e3500f0c-c422-467f-bc3e-8e7e9b4e8e09 req-86be5f96-721e-48e4-8817-61e666a7075c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172584 Aug 29 22:44:23.675320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 45/81] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:23.692044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-fe6d0c1a-245b-460b-a75b-39e86f7558f4 req-a9c461cd-bd24-4363-b417-fee610b1ac2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b065522-3ef5-4124-b4bd-87f54e94e0fe", "tag": "818cb0ea-72e6-4a8a-ba82-e595795a4d22"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:23.768396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-fe6d0c1a-245b-460b-a75b-39e86f7558f4 req-a9c461cd-bd24-4363-b417-fee610b1ac2d service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.769049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-fe6d0c1a-245b-460b-a75b-39e86f7558f4 req-a9c461cd-bd24-4363-b417-fee610b1ac2d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.769676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-fe6d0c1a-245b-460b-a75b-39e86f7558f4 req-a9c461cd-bd24-4363-b417-fee610b1ac2d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.862174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-fe6d0c1a-245b-460b-a75b-39e86f7558f4 req-a9c461cd-bd24-4363-b417-fee610b1ac2d service nova] Creating event network-changed:818cb0ea-72e6-4a8a-ba82-e595795a4d22 for instance 1b065522-3ef5-4124-b4bd-87f54e94e0fe on hv-cinder-85426 Aug 29 22:44:23.885258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-fe6d0c1a-245b-460b-a75b-39e86f7558f4 req-a9c461cd-bd24-4363-b417-fee610b1ac2d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197082 Aug 29 22:44:23.886099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 46/82] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:23.892510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:23.893571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:23.901580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.902071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.902722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:23.903809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:23.905036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:23.915003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.487158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:24.500367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0606b2e8-e82b-42ad-b3e4-94cb64804745 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 1.232540 Aug 29 22:44:24.502061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 37/83] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:23 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:24.509282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:24.510156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:24.535422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:24.537997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.538930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.539977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.540908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.542195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.543298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.630046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:24.648774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f4211394-4285-45fc-92d9-4a7573dded88 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.761260 Aug 29 22:44:24.650019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 47/84] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:23 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:24.655404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:24.669047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:24.676167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.681820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.681820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:24.681820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:24.681820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:24.682785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.075688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.084577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.086088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.087115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e2b7f237-be95-417f-989f-ddbf43537937 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.435998 Aug 29 22:44:25.088180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 48/85] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:25.152203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:25.154605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-093f7eda-050a-4dd2-9dc8-10c94b720ca0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.651250 Aug 29 22:44:25.163810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 38/86] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:24 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:25.526587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:25.527451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:25.536057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.542283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.542283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.542283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.542283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.542881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.671549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:25.677471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:25.706378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.707024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.707529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:25.710724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:25.713873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:25.718624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.419930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:26.428875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e3c8fa27-d99d-4417-97ee-4cf87758bbbc tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.761150 Aug 29 22:44:26.429714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 39/87] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:25 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:26.448616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-428d2f80-9d8b-41bf-91e6-7040a81a14e2 req-8c620dc6-02c8-437a-9e7b-6b4753b78d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82aaeac-b1e6-4be1-a5a5-0605c648b05c", "tag": "cc84dffa-2136-4ffc-be74-eb8d23cea473"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:26.460358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-428d2f80-9d8b-41bf-91e6-7040a81a14e2 req-8c620dc6-02c8-437a-9e7b-6b4753b78d1d service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.461224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-428d2f80-9d8b-41bf-91e6-7040a81a14e2 req-8c620dc6-02c8-437a-9e7b-6b4753b78d1d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.461827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-428d2f80-9d8b-41bf-91e6-7040a81a14e2 req-8c620dc6-02c8-437a-9e7b-6b4753b78d1d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.475868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-428d2f80-9d8b-41bf-91e6-7040a81a14e2 req-8c620dc6-02c8-437a-9e7b-6b4753b78d1d service nova] Creating event network-changed:cc84dffa-2136-4ffc-be74-eb8d23cea473 for instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c on hv-cinder-85426 Aug 29 22:44:26.482420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-428d2f80-9d8b-41bf-91e6-7040a81a14e2 req-8c620dc6-02c8-437a-9e7b-6b4753b78d1d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037775 Aug 29 22:44:26.483684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 40/88] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:26.490192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:26.491219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:26.499895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.500979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.501665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.503036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.503989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.504599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.542843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:26.555556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4cd0e830-ffb4-469d-8098-2e4fee9accbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 1.035148 Aug 29 22:44:26.564506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 49/89] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:25 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:26.564506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:26.564506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:26.569221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.569924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.570520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.571387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:26.571988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:26.572585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:26.913600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:26.925599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:26.929292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:26.930867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ab1b16d1-ade0-4f55-a992-486e55fb7af5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.445465 Aug 29 22:44:26.932243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 41/90] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:27.060445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:27.069314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6e0d3095-3989-4057-9b3b-9da6f5a2cecb tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.512063 Aug 29 22:44:27.096846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 50/91] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:26 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:27.450884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:27.451615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:27.462101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.462897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.463853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.464760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.465428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.466109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.577498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:27.579545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:27.591912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.592623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.593065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.593875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.594543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.596254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.733079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:27.747113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c0851aa3-e884-46b3-b53c-e32d410ce926 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.300362 Aug 29 22:44:27.749465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 42/92] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:27 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:27.955560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:27.956231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:27.968592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.970744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.971366 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.976749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:27.977482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:27.978155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:27.995279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.009879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-24545a7c-ad2a-474f-b639-d9979ce16164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.436063 Aug 29 22:44:28.027922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 51/93] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:27 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:28.093263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:28.094610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:28.118916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.119411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.120103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.120591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.121112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.121939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.488845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.500306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.503101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.504479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-81b08dcf-ccbe-4dee-8307-87f582c56ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.553421 Aug 29 22:44:28.506711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 43/94] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:44:28.715562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:28.730349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-22ef95a1-1ba7-4fb9-aedb-8a23f4cf3ae2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.642890 Aug 29 22:44:28.747748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 52/95] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:28 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:28.780675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:28.781389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:28.790047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.790560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.790980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:28.792097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:28.792692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:28.793152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.037732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:29.039036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:29.051550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.052050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.052626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.053353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.053809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.054231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.070638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.094252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ece49ede-00ea-4c82-a8aa-0ce1641be2e3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.320936 Aug 29 22:44:29.105911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 44/96] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:28 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:29.411173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.439856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-11fbf84c-199c-4dab-9747-d7ccc3459375 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.388650 Aug 29 22:44:29.439856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 53/97] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:29 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:29.531757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:29.533189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:29.546334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.548002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.548746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.551933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.552734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.558908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.745034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.753932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.756227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:29.757380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dccacc69-534c-4034-b1a5-5d31d397b564 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.230476 Aug 29 22:44:29.758423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 45/98] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:29.775475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:29.776014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:29.784348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.785014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.785599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:29.786471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:29.791693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:29.791693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.011076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.020441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5775ca38-3707-4f02-905e-9aeaafa82d80 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.249267 Aug 29 22:44:30.021820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 54/99] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:29 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:30.120733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:30.121340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:30.127524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.128013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.128482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.129172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.129623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.130043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.226389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:30.285928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.315620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4ed125d4-275e-48db-b910-8072eb267b53 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.198607 Aug 29 22:44:30.321472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 46/100] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:30 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:30.567658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:30.567658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:30.567658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.567658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.569352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.569352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.569352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.569352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.596459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.604723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-25548351-339f-44f6-a594-293bd20fb846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.161327 Aug 29 22:44:30.605253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 55/101] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:30 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:30.782755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:30.783359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:30.789906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.790385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.790816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.791498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:30.791947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:30.792391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:30.932342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.941556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.943854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:30.945020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82e397d3-5e3f-4c00-9d00-c9c28146f805 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.166320 Aug 29 22:44:30.945595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 47/102] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:31.043669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:31.044423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:31.051587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.052843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.053612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.054555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.055124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.055755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.269497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:31.277653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8a09ff3c-b589-49a4-a227-afe0e32d3ed7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.238062 Aug 29 22:44:31.278370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 56/103] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:31 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:31.340982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:31.341592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:31.347594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.348084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.348546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.350261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.351054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.351626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.515037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:31.522726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef6c6caa-038e-45c9-b33e-02b3e380c838 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.185829 Aug 29 22:44:31.523341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 48/104] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:31 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:31.626783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:31.627681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:31.629742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:31.634638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.635068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.635500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.636222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.636678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.637129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.791157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:31.800129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e93f6f7f-373e-4c70-bf47-315ba61fcf83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.177168 Aug 29 22:44:31.801230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 57/105] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:31 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:31.973391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:31.974583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:31.981264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.981744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.982184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:31.982960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:31.983414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:31.983836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.002962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:32.129382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.139524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.141584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.142928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-adf8c875-826c-4499-8341-d9c747fb5bd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.173344 Aug 29 22:44:32.144038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 49/106] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:32.299054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:32.299682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:32.308411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.308897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.309330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.310185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.310612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.311096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.456907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.456907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:32.456907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-21a80b40-e5e1-44f4-ab84-379e7670b6dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.160008 Aug 29 22:44:32.456907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 58/107] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:32 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:32.543579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:32.544269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:32.550237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.550722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.551157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.551851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.552479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.552944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.713735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.721417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ee09a9e8-cb6c-44c9-b055-8c06ae84dbb0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.181751 Aug 29 22:44:32.722001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 50/108] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:32 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:32.823122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:32.828017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:32.829941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.830421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.830850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.831531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:32.832054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:32.832505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:32.970599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:32.978235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-50b67e14-feb2-4611-93cb-bd996e87c9e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.159375 Aug 29 22:44:32.978803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 59/109] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:32 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:33.168195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:33.168915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:33.175146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.176270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.176879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.177967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.178356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.178775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.356890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.367107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.368862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.370012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-76d4e5c7-2a54-4842-ab66-5c37e5198486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.207657 Aug 29 22:44:33.371003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 51/110] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:33.477961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:33.479452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:33.486709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.487457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.488055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.489003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.489725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.490498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.710757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.718736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9c781b43-2b7e-47d1-b1fe-5f7a846516c8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.245326 Aug 29 22:44:33.719269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 60/111] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:33 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:33.742156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:33.742785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:33.748827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.749313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.749746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.750550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:33.750978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:33.751428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:33.909200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:33.917989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4f7c9f35-6aab-44bf-a6df-254ac2beaa8d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.179780 Aug 29 22:44:33.918530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 52/112] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:33 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:34.000484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:34.001004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:34.008028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.008634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.009117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.020706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.020706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.021024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.201575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.211043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e07bc41a-318f-4304-8984-e6d2bdeb5801 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.216495 Aug 29 22:44:34.211717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 61/113] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:33 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:34.394580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:34.395160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:34.401830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.402306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.402867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.403565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.403995 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.404447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.540708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.548973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.550417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.551544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1e44243f-4abd-4419-89b2-1d86cb8d8410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.160958 Aug 29 22:44:34.553089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 53/114] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:34.738862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:34.739566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:34.745868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.746429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.746861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.747545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.747992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.748430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.883824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:34.892076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b05a6fbe-9945-4998-a014-37c8a91e61b6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.157118 Aug 29 22:44:34.892703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 62/115] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:34 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:34.952084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:34.952708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:34.959753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.960021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.960510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:34.963105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:34.963105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:34.963105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.095064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.104694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-89650e7d-14be-4bc9-be0a-a5f605d9bef2 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.156425 Aug 29 22:44:35.119479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 54/116] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:34 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:35.233229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:35.233827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:35.240569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.241232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.241659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.242338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.242785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.243194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.371627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.379660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-48212d8e-9a81-4117-9acb-1517fbc28e61 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.150396 Aug 29 22:44:35.380323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 63/117] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:35 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:35.575425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:35.575958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:35.582115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.583149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.584321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.590207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.590207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.590207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.719561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.727923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.729477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:35.730689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2a53a5d8-e43a-4de8-bc90-377441bb7e8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.159642 Aug 29 22:44:35.731365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 55/118] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:35.915008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:35.915619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:35.921755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.922741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.922850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:35.923468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:35.923923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:35.924414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.099283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.099283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c215c599-22f9-4f17-a348-ab6e870dd2e0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.164672 Aug 29 22:44:36.099283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 64/119] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:35 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:36.129382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:36.130892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:36.137738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.138236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.138654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.139322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.139813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.140379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.290771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.298911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-464cb67b-3eb2-42ee-94bc-e45506d2e38c tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.175149 Aug 29 22:44:36.299472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 56/120] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:36 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:36.400879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:36.401480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:36.407795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.408314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.408745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.409429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.409905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.410363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.548680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.557421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-722c6fa8-04f0-4089-9730-8cfdbce2aa5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.160290 Aug 29 22:44:36.558058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 65/121] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:36 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:36.754624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:36.754624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:36.762115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.762633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.763057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.763742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:36.764209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:36.764626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:36.903910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.913321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.915108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:36.916334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3d4c97af-b4ed-4f51-82c5-5011e8bba2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.166466 Aug 29 22:44:36.916906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 57/122] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:37.097459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:37.098067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:37.104799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.105285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.105727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.106413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.106858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.107274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.263436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:37.283390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ebd836e7-a59e-46b8-9181-703294a48011 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.188326 Aug 29 22:44:37.283390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 66/123] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:37 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:37.327353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:37.328832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:37.335990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.336507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.336931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.337640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.338084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.338494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.474378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:37.482645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-165db1f9-c854-4ad6-93a1-0112a3d77dfe tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.159373 Aug 29 22:44:37.483221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 58/124] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:37 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:37.579789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:37.580420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:37.586561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.587030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.587454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.588125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.588601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.589021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.719134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:37.727551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3504c4e1-1674-4ab2-8284-7881f54f7fd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.151952 Aug 29 22:44:37.728165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 67/125] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:37 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:37.939994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:37.940632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:37.946578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.947060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.947494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:37.948190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:37.948652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:37.949059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.077579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.086839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.088274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.089374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f2fdb705-bfd9-4788-bfbe-3c1dedecad65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.153574 Aug 29 22:44:38.089930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 59/126] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:38.306253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:38.306253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:38.311101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.311594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.312023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.312741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.313257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.313602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.503214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:38.503812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:38.525416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.533393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.534240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.535322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.536004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.537602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.571024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.579046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-572b30d1-2296-457a-ad9b-c06e491f7b6c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.280512 Aug 29 22:44:38.593003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 68/127] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:38 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:38.726317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.738168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-023e6b29-861a-4da0-b526-ac937e09d9b4 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.238839 Aug 29 22:44:38.753043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 60/128] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:38 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:38.762998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:38.764058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:38.771982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.772495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.772924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.773784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.774243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.774697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.925501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:38.934399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e98d80b2-6d51-44ba-afcc-08c2a902867c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.188067 Aug 29 22:44:38.935416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 69/129] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:38 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:38.974015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-3942cbed-42e4-46c9-9719-024247243672 req-59af3dbe-8568-4e61-ad6c-ac663cde9ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e568957-b28a-4d75-b458-3f8e95bb38d0", "name": "network-vif-plugged", "status": "completed", "tag": "2eaca61c-9e3d-41ec-b39b-74fe4d54599d"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:38.986017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-3942cbed-42e4-46c9-9719-024247243672 req-59af3dbe-8568-4e61-ad6c-ac663cde9ce2 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:38.986539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-3942cbed-42e4-46c9-9719-024247243672 req-59af3dbe-8568-4e61-ad6c-ac663cde9ce2 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:38.986977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-3942cbed-42e4-46c9-9719-024247243672 req-59af3dbe-8568-4e61-ad6c-ac663cde9ce2 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:38.998755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-3942cbed-42e4-46c9-9719-024247243672 req-59af3dbe-8568-4e61-ad6c-ac663cde9ce2 service nova] Creating event network-vif-plugged:2eaca61c-9e3d-41ec-b39b-74fe4d54599d for instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 on hv-cinder-85426 Aug 29 22:44:39.004219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-3942cbed-42e4-46c9-9719-024247243672 req-59af3dbe-8568-4e61-ad6c-ac663cde9ce2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105613 Aug 29 22:44:39.005389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 61/130] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:39.113545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:39.114802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:39.122452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.123083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.123545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.124296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.124954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.125408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.369630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:39.389398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:39.391087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:39.392464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7c05bba4-efa8-44ad-88c1-65d8bf817321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.283435 Aug 29 22:44:39.393134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 70/131] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:39.605931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:39.607970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:39.612849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.613267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.613710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.615010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.615532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.616932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.761764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:39.762369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:39.763207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:39.768565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.769040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.769710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.770586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.771693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.771693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.771885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e884b317-b4a2-407d-9697-64dfeb838ba0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.170014 Aug 29 22:44:39.772258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 62/132] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:39 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:39.957066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:39.957470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:39.957761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:39.966240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-07c2f5f6-ebe7-44ae-9579-2250e1495916 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.208309 Aug 29 22:44:39.967162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 71/133] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:39 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:39.967460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.968042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.968829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:39.970064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:39.970597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:39.971153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.119601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:40.128081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fbd6e9a7-26b7-4fdc-8a8e-ecd399844a6a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.175813 Aug 29 22:44:40.129018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 63/134] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:39 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:40.420559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:40.421508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:40.429169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:40.429838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:40.430274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.430984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:40.431521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:40.432327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.703723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:40.719506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:40.723114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:40.726180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d3f5389d-11a0-4c3d-9b92-29d43a065e47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.311110 Aug 29 22:44:40.727609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 72/135] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:40.793252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:40.793902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:40.799874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:40.800390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:40.800823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.801505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:40.802136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:40.802555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:40.993535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:40.994787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:41.006120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:41.008441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.009893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.010954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.011916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.012615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.013250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.024272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8967caa5-60f1-42f4-a2d6-58c72ed52a1a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.234470 Aug 29 22:44:41.026192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 64/136] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:40 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:41.151744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:41.152499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:41.161681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.170730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.172624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.173894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.174707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.175277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.212034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:41.223975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a06d2975-d9e2-481e-a4fe-30eda51d0888 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.238745 Aug 29 22:44:41.225452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 73/137] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:40 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:41.396470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:41.405920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac856ac4-c770-43af-a452-57cadac498d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.258052 Aug 29 22:44:41.416769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 65/138] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:41 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:41.755457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:41.756628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:41.765231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.765923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.766359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.767306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:41.767674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:41.768452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:41.904080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:41.913865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:41.915322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:41.916782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-18ff81b1-967f-49f3-b26b-c3ee55779bbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.167620 Aug 29 22:44:41.917482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 74/139] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:42.055604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:42.056562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:42.063206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.063734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.064289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.064924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.065379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.065799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.207131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:42.211768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:42.216655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ce4ebf6d-c853-4794-b1c4-b26ce9455566 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.165580 Aug 29 22:44:42.217235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 66/140] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:42 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:42.249322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:42.249930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:42.255910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.256441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.260678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.260678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.260678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.260678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.277482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:42.428868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:42.430381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:42.434544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:42.444697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-215cbe1f-86b9-4fcf-9e04-8f63e8adca2a tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.199069 Aug 29 22:44:42.445285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 75/141] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:42 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:42.449171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.449734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.450250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.451065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.451534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.452027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.596740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:42.604683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-15920c65-2b49-4df3-a984-4ca8ca8daea2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.180189 Aug 29 22:44:42.605244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 67/142] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:42 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:42.939257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:42.939922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:42.946669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.947150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.947642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:42.948334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:42.948786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:42.949201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.086613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.094904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.096373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.097477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-91168a37-3849-4245-b2e4-61348c0fd5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1408 microversion: 2.20 time: 0.162086 Aug 29 22:44:43.098048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 76/143] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:43.195563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-3f7b5b78-3d7a-4f4b-836c-c630e969ff11 req-c4cce756-8432-457c-9bac-8daa0f09fec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83eb8498-b123-45ae-81b5-a88bbe88cdaa", "name": "network-vif-plugged", "status": "completed", "tag": "3804445f-c321-4f1d-b09a-eb5a16ac3375"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:43.216818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-3f7b5b78-3d7a-4f4b-836c-c630e969ff11 req-c4cce756-8432-457c-9bac-8daa0f09fec7 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.217290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-3f7b5b78-3d7a-4f4b-836c-c630e969ff11 req-c4cce756-8432-457c-9bac-8daa0f09fec7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.217755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-3f7b5b78-3d7a-4f4b-836c-c630e969ff11 req-c4cce756-8432-457c-9bac-8daa0f09fec7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.230443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-3f7b5b78-3d7a-4f4b-836c-c630e969ff11 req-c4cce756-8432-457c-9bac-8daa0f09fec7 service nova] Creating event network-vif-plugged:3804445f-c321-4f1d-b09a-eb5a16ac3375 for instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa on hv-cinder-85426 Aug 29 22:44:43.235797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-3f7b5b78-3d7a-4f4b-836c-c630e969ff11 req-c4cce756-8432-457c-9bac-8daa0f09fec7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044490 Aug 29 22:44:43.236725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 68/144] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:43.238242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:43.238893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:43.245438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.245899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.249822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.249822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.249822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.249822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.382948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.420188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d8054389-d1b6-4a3a-a310-2bb870b76b22 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.185779 Aug 29 22:44:43.421885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 77/145] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:43 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:43.467196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:43.467894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:43.476524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.488888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.489662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.490916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.491396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.491777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.626414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:43.627313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:43.634910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.635485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.635918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.636634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:43.637129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:43.638324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:43.665564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.676320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4798fc71-1415-4c2c-966b-ce260f52f27d tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.214104 Aug 29 22:44:43.677728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 69/146] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:43 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:43.844484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:43.850629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-27445511-9bc6-4126-89c8-b11915005bbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.229065 Aug 29 22:44:43.855990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 78/147] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:43 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:44.120518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.121123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.127258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.127737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.128214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.128947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.129404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.129855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.263153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:44.271957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:44.273461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:44.274617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-79df1aad-dac5-41ee-9042-7be70461b645 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1599 microversion: 2.20 time: 0.158203 Aug 29 22:44:44.275194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 70/148] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:44:44.298500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8a90ed1c-5545-41f4-a1b7-98a38eeb5829 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.299038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8a90ed1c-5545-41f4-a1b7-98a38eeb5829 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.302683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:44.306024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a90ed1c-5545-41f4-a1b7-98a38eeb5829 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.306496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a90ed1c-5545-41f4-a1b7-98a38eeb5829 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.306916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a90ed1c-5545-41f4-a1b7-98a38eeb5829 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.307582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a90ed1c-5545-41f4-a1b7-98a38eeb5829 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.308023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a90ed1c-5545-41f4-a1b7-98a38eeb5829 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.308467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a90ed1c-5545-41f4-a1b7-98a38eeb5829 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.424815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8a90ed1c-5545-41f4-a1b7-98a38eeb5829 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.130219 Aug 29 22:44:44.425407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 79/149] 10.222.0.59 () {60 vars in 1316 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:44:44.443232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.443920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.450189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.450691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.451115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.451792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.452345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.455502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.586924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:44.594641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3b142e0f-323b-47e3-a9f8-a5fa5a708cc0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.155621 Aug 29 22:44:44.595204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 71/150] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:44.700217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.700718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.707340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.708793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.709822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.710508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.710964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.711539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.875884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:44.876561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:44.883581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.884066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.884523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:44.885210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:44.885669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:44.886086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.048436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:45.057548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7ff1573b-fea1-4b13-bb07-863f85b3bc38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.185595 Aug 29 22:44:45.058170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 72/151] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:45.229074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:45.236982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5bc0f20c-23cc-40f7-afc5-d0b9d5c4b24e tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.541237 Aug 29 22:44:45.237535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 80/152] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:44 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:45.260272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-fbab3eb8-5c0c-442b-8266-17148b8c72db req-c1fab24e-fc60-431c-8233-5f17bfb94dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82aaeac-b1e6-4be1-a5a5-0605c648b05c", "name": "network-vif-plugged", "status": "completed", "tag": "cc84dffa-2136-4ffc-be74-eb8d23cea473"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:45.269619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fbab3eb8-5c0c-442b-8266-17148b8c72db req-c1fab24e-fc60-431c-8233-5f17bfb94dd9 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:45.270711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fbab3eb8-5c0c-442b-8266-17148b8c72db req-c1fab24e-fc60-431c-8233-5f17bfb94dd9 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:45.270997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fbab3eb8-5c0c-442b-8266-17148b8c72db req-c1fab24e-fc60-431c-8233-5f17bfb94dd9 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.282195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-fbab3eb8-5c0c-442b-8266-17148b8c72db req-c1fab24e-fc60-431c-8233-5f17bfb94dd9 service nova] Creating event network-vif-plugged:cc84dffa-2136-4ffc-be74-eb8d23cea473 for instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c on hv-cinder-85426 Aug 29 22:44:45.288263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-fbab3eb8-5c0c-442b-8266-17148b8c72db req-c1fab24e-fc60-431c-8233-5f17bfb94dd9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031410 Aug 29 22:44:45.288866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 73/153] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:45.617818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:45.618425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:45.624564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:45.625062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:45.625492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.626216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:45.626707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:45.627170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:45.838427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:45.846410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b1afe8f1-c7de-422c-abc0-7739b32f3e7b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.233497 Aug 29 22:44:45.847113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 81/154] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:45 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:46.022166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-40b8edfa-3ac1-40dc-843a-ed22ffb58f3b req-00de2b0e-5f06-4125-8c49-38c825de98b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e568957-b28a-4d75-b458-3f8e95bb38d0", "tag": "2eaca61c-9e3d-41ec-b39b-74fe4d54599d"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:46.037785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-40b8edfa-3ac1-40dc-843a-ed22ffb58f3b req-00de2b0e-5f06-4125-8c49-38c825de98b4 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.038435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-40b8edfa-3ac1-40dc-843a-ed22ffb58f3b req-00de2b0e-5f06-4125-8c49-38c825de98b4 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.039057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-40b8edfa-3ac1-40dc-843a-ed22ffb58f3b req-00de2b0e-5f06-4125-8c49-38c825de98b4 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.056422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-40b8edfa-3ac1-40dc-843a-ed22ffb58f3b req-00de2b0e-5f06-4125-8c49-38c825de98b4 service nova] Creating event network-changed:2eaca61c-9e3d-41ec-b39b-74fe4d54599d for instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 on hv-cinder-85426 Aug 29 22:44:46.078944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:46.079546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:46.086193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-40b8edfa-3ac1-40dc-843a-ed22ffb58f3b req-00de2b0e-5f06-4125-8c49-38c825de98b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068425 Aug 29 22:44:46.091594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 74/155] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:46.092216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.092723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.093211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.093919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.097261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.097891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.263950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:46.264820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:46.275129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.275679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.275679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.276396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.276851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.277405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.328716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:46.341086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-edd54b9f-204a-4136-a234-9911f53bfca2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.265927 Aug 29 22:44:46.342206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 82/156] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:46 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:46.454157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:46.463497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d2d4a7cc-1a12-4ab8-b93b-944e5471275f tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.204183 Aug 29 22:44:46.481240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 75/157] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:46 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:46.869496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:46.870161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:46.876870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.877649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.878287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:46.879076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:46.879762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:46.880875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:47.050708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:47.059552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ddf7688c-f7af-4760-b81d-fabba4f43121 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.195525 Aug 29 22:44:47.060768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 83/158] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:46 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:47.366145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:47.368476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:47.376090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:47.376954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:47.378482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:47.380220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:47.380863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:47.381510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:47.487473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:47.490001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:47.499683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:47.499683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:47.499683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:47.500449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:47.501298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:47.501945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:47.703205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:47.712764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2adf4b24-5682-4de3-8fa2-4f9467da15c0 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1314 microversion: 2.1 time: 0.231137 Aug 29 22:44:47.713670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 84/159] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:47 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:47.910027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:47.933936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5b2474bf-7560-416a-9031-c42d582297c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.574843 Aug 29 22:44:47.948912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 76/160] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:47 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:48.039374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-6690aa4c-6648-4652-af2f-aa242339ed1c req-c82e32bb-5ac6-4f9e-bcb8-5fed5791696e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aa52d5-e323-47c3-b4ea-6f4391575689", "name": "network-vif-plugged", "status": "completed", "tag": "6be4ff40-5348-4f0a-b930-dd182b22d3a4"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:48.049201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-6690aa4c-6648-4652-af2f-aa242339ed1c req-c82e32bb-5ac6-4f9e-bcb8-5fed5791696e service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.049679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-6690aa4c-6648-4652-af2f-aa242339ed1c req-c82e32bb-5ac6-4f9e-bcb8-5fed5791696e service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.050104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-6690aa4c-6648-4652-af2f-aa242339ed1c req-c82e32bb-5ac6-4f9e-bcb8-5fed5791696e service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.062967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-6690aa4c-6648-4652-af2f-aa242339ed1c req-c82e32bb-5ac6-4f9e-bcb8-5fed5791696e service nova] Creating event network-vif-plugged:6be4ff40-5348-4f0a-b930-dd182b22d3a4 for instance 91aa52d5-e323-47c3-b4ea-6f4391575689 on hv-cinder-85426 Aug 29 22:44:48.068001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-6690aa4c-6648-4652-af2f-aa242339ed1c req-c82e32bb-5ac6-4f9e-bcb8-5fed5791696e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033112 Aug 29 22:44:48.069117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 85/161] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:44:48.083433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:48.084439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:48.110853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.111294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.111770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.112593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.112919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.113314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.295805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:48.303846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef9211ef-b36e-4ab3-a777-8b03e926b316 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.224956 Aug 29 22:44:48.304548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 77/162] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:48 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:48.736426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:48.737160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:48.748165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.748934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.751856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.751856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.751856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.751856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.970438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:48.971367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:48.978016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:48.979791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.980560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.981058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.981918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:48.982384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:48.982810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:48.985910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-11c0f3dd-775d-461e-bf96-0069c64b1dd5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1501 microversion: 2.1 time: 0.255758 Aug 29 22:44:49.003243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 86/163] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:48 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:49.132558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:49.141471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6f91be80-f87d-4388-b324-c52068c547f1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.174911 Aug 29 22:44:49.142033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 78/164] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:48 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:49.325008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:49.325624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:49.331711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:49.332225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:49.332915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:49.333731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:49.334181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:49.334604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:49.483570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:49.492219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bdf42200-e3ce-46a0-b6b6-e682259bef1b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1363 microversion: 2.1 time: 0.171005 Aug 29 22:44:49.492795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 87/165] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:49 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:50.083910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-2bac71f9-62fa-4231-9b51-9fc6f6d6a452 req-be657d42-2de0-45fb-86ba-716068ef03a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b065522-3ef5-4124-b4bd-87f54e94e0fe", "name": "network-vif-plugged", "status": "completed", "tag": "818cb0ea-72e6-4a8a-ba82-e595795a4d22"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:50.093323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-2bac71f9-62fa-4231-9b51-9fc6f6d6a452 req-be657d42-2de0-45fb-86ba-716068ef03a4 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:50.093789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-2bac71f9-62fa-4231-9b51-9fc6f6d6a452 req-be657d42-2de0-45fb-86ba-716068ef03a4 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:50.094269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-2bac71f9-62fa-4231-9b51-9fc6f6d6a452 req-be657d42-2de0-45fb-86ba-716068ef03a4 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.112928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-2bac71f9-62fa-4231-9b51-9fc6f6d6a452 req-be657d42-2de0-45fb-86ba-716068ef03a4 service nova] Creating event network-vif-plugged:818cb0ea-72e6-4a8a-ba82-e595795a4d22 for instance 1b065522-3ef5-4124-b4bd-87f54e94e0fe on hv-cinder-85426 Aug 29 22:44:50.123254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-2bac71f9-62fa-4231-9b51-9fc6f6d6a452 req-be657d42-2de0-45fb-86ba-716068ef03a4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042882 Aug 29 22:44:50.124468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 79/166] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:44:50.163109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:50.163715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:50.171820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:50.172357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:50.172794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.173504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:50.174007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:50.174385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.454285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:50.464377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4f107365-ee07-4d06-94be-0b6e84e454eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.305606 Aug 29 22:44:50.476559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 88/167] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:50 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:50.515451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:50.516254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:50.523382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:50.524275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:50.524901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.525830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:50.526647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:50.527181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.675113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:50.685187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6b760fa5-7239-4da3-90d0-91c57cb7bc72 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1550 microversion: 2.1 time: 0.173364 Aug 29 22:44:50.685776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 80/168] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:50 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:50.706191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cef0adb1-0fd1-4ecd-8ac0-0fede08fb2e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:50.706702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cef0adb1-0fd1-4ecd-8ac0-0fede08fb2e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:50.713699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cef0adb1-0fd1-4ecd-8ac0-0fede08fb2e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:50.714184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cef0adb1-0fd1-4ecd-8ac0-0fede08fb2e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:50.714626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cef0adb1-0fd1-4ecd-8ac0-0fede08fb2e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.715304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cef0adb1-0fd1-4ecd-8ac0-0fede08fb2e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:50.715748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cef0adb1-0fd1-4ecd-8ac0-0fede08fb2e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:50.716218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cef0adb1-0fd1-4ecd-8ac0-0fede08fb2e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:50.797620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cef0adb1-0fd1-4ecd-8ac0-0fede08fb2e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095300 Aug 29 22:44:50.798375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 89/169] 10.222.0.59 () {58 vars in 1275 bytes} [Mon Aug 29 22:44:50 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:51.443898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9e01e00e-0f91-4996-9a83-e51a57b12236 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2874bdce-f963-4421-b95a-81033bd78083"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:51.446871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9e01e00e-0f91-4996-9a83-e51a57b12236 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:51.454541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9e01e00e-0f91-4996-9a83-e51a57b12236 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:51.455522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9e01e00e-0f91-4996-9a83-e51a57b12236 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:51.459397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9e01e00e-0f91-4996-9a83-e51a57b12236 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:51.460834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9e01e00e-0f91-4996-9a83-e51a57b12236 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:51.461537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9e01e00e-0f91-4996-9a83-e51a57b12236 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:51.462174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9e01e00e-0f91-4996-9a83-e51a57b12236 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:51.487200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:51.487815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:51.501903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:51.504889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:51.507323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:51.508406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:51.509068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:51.512558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:51.732220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:51.740929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b767e9b4-4585-457f-9c4f-69227fc33468 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.258391 Aug 29 22:44:51.741496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 90/170] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:51 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:52.413810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-7dbd0ee8-bf45-4d0b-81cc-833d9bd1176e req-6ed75ad6-8da2-49c5-91b2-c48ce48de5ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82aaeac-b1e6-4be1-a5a5-0605c648b05c", "tag": "cc84dffa-2136-4ffc-be74-eb8d23cea473"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:52.424646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-7dbd0ee8-bf45-4d0b-81cc-833d9bd1176e req-6ed75ad6-8da2-49c5-91b2-c48ce48de5ed service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:52.425176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-7dbd0ee8-bf45-4d0b-81cc-833d9bd1176e req-6ed75ad6-8da2-49c5-91b2-c48ce48de5ed service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:52.425559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-7dbd0ee8-bf45-4d0b-81cc-833d9bd1176e req-6ed75ad6-8da2-49c5-91b2-c48ce48de5ed service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:52.439005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-7dbd0ee8-bf45-4d0b-81cc-833d9bd1176e req-6ed75ad6-8da2-49c5-91b2-c48ce48de5ed service nova] Creating event network-changed:cc84dffa-2136-4ffc-be74-eb8d23cea473 for instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c on hv-cinder-85426 Aug 29 22:44:52.447670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-7dbd0ee8-bf45-4d0b-81cc-833d9bd1176e req-6ed75ad6-8da2-49c5-91b2-c48ce48de5ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036537 Aug 29 22:44:52.449321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 91/171] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:44:52.763203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:52.764343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:52.773327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:52.774201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:52.775396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:52.776470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:52.777151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:52.777829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:52.928420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:52.936688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e91def01-9ca9-4dd5-87d6-1c7bb1bf7d1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1321 microversion: 2.1 time: 0.178398 Aug 29 22:44:52.937364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 92/172] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:52 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:53.084590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9e01e00e-0f91-4996-9a83-e51a57b12236 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "POST /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.646143 Aug 29 22:44:53.087996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 81/173] 10.222.0.59 () {60 vars in 1323 bytes} [Mon Aug 29 22:44:51 2022] POST /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa/os-volume_attachments => generated 194 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:44:53.964895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:53.964895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:53.965420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:53.965633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:53.966057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:53.966918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:53.967514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:53.968173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:54.228809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:54.236718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-df4c08dc-5a60-4502-959a-ab62ca0a0b26 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1516 microversion: 2.1 time: 0.282283 Aug 29 22:44:54.237460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 93/174] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:53 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:54.277332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:44:54.285412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:54.293591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:54.296941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:54.296941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:54.296941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:54.296941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:54.297449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:54.319928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lazy-loading 'flavor' on Instance uuid 1b065522-3ef5-4124-b4bd-87f54e94e0fe {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:44:54.600169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:54.700812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-adbd6b79-c00d-41b1-adc3-2b8ca1e91d11 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe/action" status: 200 len: 32 microversion: 2.1 time: 0.433101 Aug 29 22:44:54.706922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 82/175] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:44:54 2022] POST /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe/action => generated 32 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:44:54.711470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:54.712199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:54.718684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:54.719246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:54.719754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:54.720584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:54.721272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:54.721923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:54.727620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:54.879521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:54.887931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3e3cefca-7e00-4537-8edc-2a5601ed1720 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.180656 Aug 29 22:44:54.892779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 94/176] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:54 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:44:55.911575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:55.912392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:55.919981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:55.920708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:55.921158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:55.921861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:55.922849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:55.922948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:56.067778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:56.071546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3e947d74-4e54-4dc4-8cf2-b9cb5bab1db6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.166167 Aug 29 22:44:56.072107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 83/177] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:55 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:57.100038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:57.100038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:57.100038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:57.101038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:57.101038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:57.101998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:57.102457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:57.102883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:57.286605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:57.294938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-09b92f57-3d52-4d92-8b03-c246913a4a19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.205878 Aug 29 22:44:57.302431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 95/178] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:57 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:58.317200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:58.317826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:58.321138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=92 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:44:58.326206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:58.326797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:58.327225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:58.327902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:58.328503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:58.328922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:58.463099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:58.470901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a47a7331-dee5-4853-9249-433cedb07cea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.157897 Aug 29 22:44:58.471479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 84/179] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:58 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:44:59.492122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:44:59.494141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:44:59.500228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:59.500757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:59.501224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:59.501947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:44:59.502394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:44:59.502992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:44:59.646194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:44:59.660036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fc1434b1-6612-4418-a613-2b1199547ad1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.166422 Aug 29 22:44:59.660036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 96/180] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:44:59 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:00.676362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:00.677578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:00.684921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:00.693616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:00.693616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:00.693616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:00.693616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:00.694205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:00.851052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:00.859661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a6341284-07e9-431e-9f15-7344b3885dc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.186848 Aug 29 22:45:00.860186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 85/181] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:00 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:01.890824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:01.892085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:01.912120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:01.914940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:01.914940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:01.915670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:01.916563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:01.917186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:02.159322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:02.168602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a40fab0a-80a7-4be0-bb1d-3a4fc97c5aaa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.286500 Aug 29 22:45:02.169275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 97/182] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:01 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:03.191496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:03.192244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:03.198753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:03.199245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:03.199683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:03.200443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:03.201040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:03.201546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:03.394918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:03.404542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-db2cb27f-a76a-43c1-8a6d-5d77c356525c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.217011 Aug 29 22:45:03.421908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 86/183] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:03 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:04.428288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:04.429464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:04.439199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:04.440345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:04.440985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:04.441966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:04.442727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:04.443318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:04.621946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:04.631117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-36f09522-523d-46ab-b185-31147ed67ace tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.208122 Aug 29 22:45:04.631777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 98/184] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:04 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:05.652503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:05.653126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:05.659534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:05.660012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:05.660487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:05.661201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:05.661640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:05.662060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:05.824829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:05.834332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7b83f9f8-827b-4fc3-b994-6e2c9e3117fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.185871 Aug 29 22:45:05.837160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 87/185] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:05 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:06.860051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:06.861309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:06.867591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:06.868213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:06.868925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:06.870023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:06.870495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:06.871457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:07.083563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:07.092205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d04c2da5-5999-44c7-a150-310e4593caa4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.236511 Aug 29 22:45:07.092795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 99/186] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:06 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:07.221028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:07.222170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:07.229486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:07.230274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:07.231266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:07.231424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:07.231891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:07.232376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:07.265773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:45:07.616277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-440f8023-5ef6-43f4-a1b4-94cf9c5c5bfb tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "DELETE /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 204 len: 0 microversion: 2.1 time: 0.398732 Aug 29 22:45:07.616902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 88/187] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 22:45:07 2022] DELETE /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:45:07.624930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:07.625529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:07.631470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:07.631945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:07.632410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:07.633091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:07.633534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:07.633947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:07.779558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:07.794213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6bcb4802-3b1b-4d83-b724-d100ff838ff3 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1553 microversion: 2.1 time: 0.172990 Aug 29 22:45:07.794793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 100/188] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:07 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:08.114597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:08.115286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:08.122068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:08.122524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:08.123083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:08.123949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:08.124432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:08.124847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:08.270882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:08.279733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e81741e3-c632-49e9-b75f-53573dabd45f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.169727 Aug 29 22:45:08.280344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 89/189] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:08 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:08.816529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:08.817228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:08.826445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:08.826952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:08.827384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:08.828402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:08.828871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:08.835332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:08.984165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:08.998242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4a95dec6-c113-41e6-a2f1-c020e79cc1af tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1553 microversion: 2.1 time: 0.186174 Aug 29 22:45:09.004237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 101/190] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:08 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:09.301810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:09.302447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:09.309666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:09.310143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:09.310570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:09.311260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:09.311704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:09.312349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:09.454337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:09.463840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b1db40e5-87b4-4c7a-8dec-97667f01e6f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.165798 Aug 29 22:45:09.477513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 90/191] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:09 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:10.026009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:10.026795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:10.033598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:10.034191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:10.034702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:10.035973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:10.035973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:10.036623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:10.244599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:10.256148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-47c264e3-f152-47be-9875-d8e97b672a97 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1553 microversion: 2.1 time: 0.234072 Aug 29 22:45:10.263287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 102/192] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:10 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:10.487343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:10.489196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:10.497126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:10.497621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:10.498062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:10.498762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:10.499219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:10.499642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:10.667514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:10.677316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5250e8e4-fe08-4862-ae94-c30eb8c8285f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.194006 Aug 29 22:45:10.679344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 91/193] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:10 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:10.942071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-6d4c99bd-ab97-463e-9a35-9e7a97daa40a req-739858b6-9b0a-4b7b-9406-36293b795dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83eb8498-b123-45ae-81b5-a88bbe88cdaa", "name": "network-vif-deleted", "tag": "3804445f-c321-4f1d-b09a-eb5a16ac3375"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:10.964860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-6d4c99bd-ab97-463e-9a35-9e7a97daa40a req-739858b6-9b0a-4b7b-9406-36293b795dc1 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:10.974072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-6d4c99bd-ab97-463e-9a35-9e7a97daa40a req-739858b6-9b0a-4b7b-9406-36293b795dc1 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:10.974816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-6d4c99bd-ab97-463e-9a35-9e7a97daa40a req-739858b6-9b0a-4b7b-9406-36293b795dc1 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:10.994477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-6d4c99bd-ab97-463e-9a35-9e7a97daa40a req-739858b6-9b0a-4b7b-9406-36293b795dc1 service nova] Creating event network-vif-deleted:3804445f-c321-4f1d-b09a-eb5a16ac3375 for instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa on hv-cinder-85426 Aug 29 22:45:11.000282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-6d4c99bd-ab97-463e-9a35-9e7a97daa40a req-739858b6-9b0a-4b7b-9406-36293b795dc1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067539 Aug 29 22:45:11.005442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 103/194] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:11.278522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:11.279126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:11.285322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:11.285778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:11.286201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:11.286890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:11.287418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:11.287837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:11.355505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:11.363837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a9fcfa16-96b1-436d-9ed2-f5d81cce2447 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1345 microversion: 2.1 time: 0.089498 Aug 29 22:45:11.364436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 92/195] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:11 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:11.704623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:11.707939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:11.715120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:11.715611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:11.716372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:11.717078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:11.717659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:11.717987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:11.889853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:11.897740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bba27a14-a3d2-468e-8e6d-a0d4dcb07175 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.198283 Aug 29 22:45:11.898320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 104/196] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:11 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:12.386225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:12.387059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:12.393624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:12.394103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:12.394532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:12.395236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:12.395679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:12.396099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:12.432684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:12.433172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:12.433591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:12.434189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lazy-loading 'fault' on Instance uuid 83eb8498-b123-45ae-81b5-a88bbe88cdaa {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:45:12.483774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b21dc8a79bce4b26a690d8990c52116c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844009bb229a4357bb183c22473ec045', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:12.498556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1eb074b5-de80-4a1b-8f6f-ff5a08e10136 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 200 len: 1350 microversion: 2.1 time: 0.116794 Aug 29 22:45:12.505670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 93/197] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:12 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 1350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:12.926128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:12.926739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:12.933259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:12.933713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:12.934143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:12.934835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:12.935810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:12.936256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:13.105804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:13.114009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-31a6e10c-f1f9-409a-ba2d-c647dca3499b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.191732 Aug 29 22:45:13.126099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 105/198] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:12 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:13.521205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:13.521923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:13.529726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:13.529726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:13.529726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:13.530145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:13.530600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:13.531026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:13.545278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] HTTP exception thrown: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Request method failure captured: Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa HTTP/1.1 Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUExI-cnpWMRuZa9ajHsvRcI4n43OMDqbevWPczSmeJYnTSKyCM7MyW1TNrOttcLb5_tcRnGRMqRXHJ2YLboB63zU5zi7O2q3cWJr2HuEto3qinaDntPuipPbO9XvRmWknatqTOZ0tVX0mf0Sc40qXUO8oIz306yMdRyeeR_hJdvwtA Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 844009bb229a4357bb183c22473ec045 Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 22:45:13.549958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/844009bb229a4357bb183c22473ec045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/844009bb229a4357bb183c22473ec045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_844009bb229a4357bb183c22473ec045", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/844009bb229a4357bb183c22473ec045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 844009bb229a4357bb183c22473ec045 Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-DeleteServersTestJSON-1720501655-project Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: b21dc8a79bce4b26a690d8990c52116c Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-DeleteServersTestJSON-1720501655-project Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.551229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '83eb8498-b123-45ae-81b5-a88bbe88cdaa'} Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:45:13.552359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.554120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.557094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Returning 404 to user: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:45:13.557094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eb3cb0d6-41ea-4672-83c3-9a26ec162150 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 404 len: 111 microversion: 2.1 time: 0.034221 Aug 29 22:45:13.557094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 94/199] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:13 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:45:13.668359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:13.670597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:13.687008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:13.687008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:13.687008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:13.687008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:13.687601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:13.687601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:13.703030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] HTTP exception thrown: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Request method failure captured: Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa/os-volume_attachments HTTP/1.1 Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUExI-cnpWMRuZa9ajHsvRcI4n43OMDqbevWPczSmeJYnTSKyCM7MyW1TNrOttcLb5_tcRnGRMqRXHJ2YLboB63zU5zi7O2q3cWJr2HuEto3qinaDntPuipPbO9XvRmWknatqTOZ0tVX0mf0Sc40qXUO8oIz306yMdRyeeR_hJdvwtA Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 844009bb229a4357bb183c22473ec045 Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:45:13.707612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/844009bb229a4357bb183c22473ec045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/844009bb229a4357bb183c22473ec045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_844009bb229a4357bb183c22473ec045", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/844009bb229a4357bb183c22473ec045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 844009bb229a4357bb183c22473ec045 Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-DeleteServersTestJSON-1720501655-project Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: b21dc8a79bce4b26a690d8990c52116c Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-DeleteServersTestJSON-1720501655-project Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.717102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'server_id': '83eb8498-b123-45ae-81b5-a88bbe88cdaa'} Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:45:13.717891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:13.719165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:13.720708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Returning 404 to user: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:45:13.720708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a6c75596-7818-4aee-a685-e85c1ee342aa tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044989 Aug 29 22:45:13.720708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 106/200] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:45:13 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:45:14.134788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:14.135415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:14.153461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:14.154118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:14.154803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:14.156177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:14.156845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:14.157447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:14.317272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:14.325519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-928240aa-fd8d-452f-bd77-1307ba2a8511 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.194630 Aug 29 22:45:14.326092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 95/201] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:14 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:15.113145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:15.113630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:15.115730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=55 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:15.121198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:15.121700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:15.125154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:15.125154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:15.125154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:15.125154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:15.139094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] HTTP exception thrown: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Request method failure captured: Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa HTTP/1.1 Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUExI-cnpWMRuZa9ajHsvRcI4n43OMDqbevWPczSmeJYnTSKyCM7MyW1TNrOttcLb5_tcRnGRMqRXHJ2YLboB63zU5zi7O2q3cWJr2HuEto3qinaDntPuipPbO9XvRmWknatqTOZ0tVX0mf0Sc40qXUO8oIz306yMdRyeeR_hJdvwtA Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 844009bb229a4357bb183c22473ec045 Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:45:15.141318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/844009bb229a4357bb183c22473ec045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/844009bb229a4357bb183c22473ec045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_844009bb229a4357bb183c22473ec045", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/844009bb229a4357bb183c22473ec045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 844009bb229a4357bb183c22473ec045 Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-DeleteServersTestJSON-1720501655-project Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: b21dc8a79bce4b26a690d8990c52116c Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-DeleteServersTestJSON-1720501655-project Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.146584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '83eb8498-b123-45ae-81b5-a88bbe88cdaa'} Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:45:15.147582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.148764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.150059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Returning 404 to user: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:45:15.150059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f98fee41-5b7b-42ec-9533-0bbccc710d93 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "DELETE /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 404 len: 111 microversion: 2.1 time: 0.033453 Aug 29 22:45:15.150059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 107/202] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 22:45:15 2022] DELETE /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:45:15.151997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:15.152625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] [instance: 83eb8498-b123-45ae-81b5-a88bbe88cdaa] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:15.159864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:15.160393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:15.160826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:15.161692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:15.162151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:15.162566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:15.176728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] HTTP exception thrown: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Request method failure captured: Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa HTTP/1.1 Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUExI-cnpWMRuZa9ajHsvRcI4n43OMDqbevWPczSmeJYnTSKyCM7MyW1TNrOttcLb5_tcRnGRMqRXHJ2YLboB63zU5zi7O2q3cWJr2HuEto3qinaDntPuipPbO9XvRmWknatqTOZ0tVX0mf0Sc40qXUO8oIz306yMdRyeeR_hJdvwtA Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 844009bb229a4357bb183c22473ec045 Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 22:45:15.178266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/844009bb229a4357bb183c22473ec045"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/844009bb229a4357bb183c22473ec045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_844009bb229a4357bb183c22473ec045", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/844009bb229a4357bb183c22473ec045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 844009bb229a4357bb183c22473ec045 Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720501655 Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-DeleteServersTestJSON-1720501655-project Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: b21dc8a79bce4b26a690d8990c52116c Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-DeleteServersTestJSON-1720501655-project Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.179722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '83eb8498-b123-45ae-81b5-a88bbe88cdaa'} Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:45:15.180530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. Aug 29 22:45:15.182482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:45:15.184242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] Returning 404 to user: Instance 83eb8498-b123-45ae-81b5-a88bbe88cdaa could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:45:15.184242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b8f08b62-93a5-4e94-b2b5-8d24b1cc1aa5 tempest-DeleteServersTestJSON-1720501655 tempest-DeleteServersTestJSON-1720501655-project] 10.222.0.59 "GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa" status: 404 len: 111 microversion: 2.1 time: 0.031902 Aug 29 22:45:15.184447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 96/203] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:15 2022] GET /compute/v2.1/servers/83eb8498-b123-45ae-81b5-a88bbe88cdaa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:45:15.347785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:15.348748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:15.358952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:15.359546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:15.359977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:15.360724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:15.361170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:15.361579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:15.509779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:15.520965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1c1d26f6-e279-4156-bd50-a06db3246541 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.177063 Aug 29 22:45:15.521809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 108/204] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:15 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:16.545233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:16.545233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:16.550784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:16.551313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:16.551748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:16.552461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:16.552905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:16.553321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:16.816007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:16.831811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f096642a-03eb-498c-a64e-25a9fcb8f84d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.288750 Aug 29 22:45:16.831811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 97/205] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:16 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:17.851545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:17.856367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:17.867850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:17.869004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:17.869768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:17.870605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:17.871447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:17.871881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:18.016588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:18.024296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-13a8cd2f-82cb-410c-85ce-569ff71d883f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.177230 Aug 29 22:45:18.025951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 109/206] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:17 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:19.047455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:19.048919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:19.055726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:19.056986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:19.057609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:19.058794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:19.059341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:19.059679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:19.241101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:19.246528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:19.252294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-02229a39-6e6c-4038-892b-9d9692b96db2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.208681 Aug 29 22:45:19.252992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 98/207] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:19 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:20.276854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:20.277459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:20.284364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:20.284855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:20.285322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:20.286052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:20.286506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:20.286926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:20.489106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:20.507701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a4455933-6ddc-4b49-bf79-f7eaa580e016 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.229431 Aug 29 22:45:20.522104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 110/208] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:20 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:21.532670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:21.534510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:21.543706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:21.544280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:21.545272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:21.546932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:21.547604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:21.548029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:21.731997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:21.740515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-94b9c56b-8bb5-4f4c-8c12-6e4ba95fb8ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.213588 Aug 29 22:45:21.741822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 99/209] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:21 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:22.762278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:22.762915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:22.768950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:22.769434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:22.769900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:22.770581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:22.771035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:22.771456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:23.216622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:23.224320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-855cd276-943c-4cbc-9ebd-3d221005b496 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.466505 Aug 29 22:45:23.225122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 111/210] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:22 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:24.248236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:24.248896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:24.256077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:24.256594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:24.257022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:24.257762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:24.258187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:24.259278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:24.480015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:24.480015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-05d1dca4-9abd-4b4c-926a-d4c7e02dc7aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.221846 Aug 29 22:45:24.480015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 100/211] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:24 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:25.488929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:25.490177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:25.502873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:25.510850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:25.511511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:25.512473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:25.517373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:25.517373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:25.788189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:25.794911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:25.802138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b7497c10-096b-4754-9db1-66dc5ab5eaf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.317487 Aug 29 22:45:25.802738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 112/212] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:25 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:26.825986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:26.826716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:26.834164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:26.834817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:26.835540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:26.836522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:26.837671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:26.838257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:27.031496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:27.053920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3a274d8d-8746-4ac6-b65c-d400d49bf818 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.230460 Aug 29 22:45:27.054763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 101/213] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:26 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:28.094258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:28.095817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:28.106056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:28.106545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:28.107390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:28.107961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:28.108597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:28.109019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:28.681444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:28.690135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-707a66b4-b541-4418-b749-4d9d7eccefcc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.609060 Aug 29 22:45:28.690709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 113/214] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:28 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:29.170271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6d038184-d244-4844-82d9-e86d90084bc4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: .version_select at 0x7febd521c040>, body: {"keypair": {"name": "tempest-keypair-571313605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsj4SrIsxjWhfTjB+pPOEKDAE4MTONba4IlPbUrtM/JK+Rvae4Ge8/FNwoo+WpuZRDSyRxXjHXCE5IuSRiv3zUThL+GP8HvmLDJIFCxGa2agnh/FUdtiBYJfCP2rHUYcQ=="}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:29.175797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:29.187519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-6d038184-d244-4844-82d9-e86d90084bc4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for project a826c462a3fa429eb866d354afcbe950. Resources: {'key_pairs'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:45:29.191946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-6d038184-d244-4844-82d9-e86d90084bc4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for user 9c2fdfdb62b54f05b7d81f14ec197cca and project a826c462a3fa429eb866d354afcbe950. Resources: {'key_pairs'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:45:29.302773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6d038184-d244-4844-82d9-e86d90084bc4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.369509 Aug 29 22:45:29.303469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 102/215] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 22:45:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:29.715369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:29.716211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:29.723760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:29.724546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:29.725049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:29.725810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:29.726330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:29.726763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:29.884951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:29.894276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f5b4df0d-2172-4338-8a03-580cb2cb5c51 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.186683 Aug 29 22:45:29.895672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 114/216] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:29 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:30.929435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:30.930924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:30.940604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:30.941425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:30.942287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:30.943974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:30.944891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:30.945473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:31.162742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:31.171755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-38238ff4-4404-4df7-944f-477009be1bb6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.257892 Aug 29 22:45:31.185664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 103/217] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:30 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:32.195249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:32.196231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:32.204908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:32.208713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:32.220768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:32.221634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:32.222481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:32.222574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:32.377034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-827920809", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02e67e56-1d54-4626-ac0f-73743cdc8b11"}], "security_groups": [{"name": "tempest-securitygroup--1453656910"}], "key_name": "tempest-keypair-571313605", "user_data": "}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:32.435326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:32.466772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9d05ed54-1a42-4ddc-a37e-fd4e4155f85e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.276439 Aug 29 22:45:32.471531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 115/218] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:32 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:32.552854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.network.neutron [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] validate_networks() for [('02e67e56-1d54-4626-ac0f-73743cdc8b11', None, None, None, None, None)] {{(pid=128151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:45:33.256371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Flavor limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:45:33.256976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Image limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:45:33.257441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Flavor pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:45:33.257847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Image pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:45:33.258745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:45:33.268832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:33.269307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:33.269910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:33.270861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:33.271539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:33.272190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:33.290410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for project a826c462a3fa429eb866d354afcbe950. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:45:33.294589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for user 9c2fdfdb62b54f05b7d81f14ec197cca and project a826c462a3fa429eb866d354afcbe950. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:45:33.307319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Going to run 1 instances... {{(pid=128151) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:45:33.309776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:45:33.491517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:33.492776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:33.499507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:33.500210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:33.500826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:33.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:33.501979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:33.502404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:33.527785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-931c1373-a6a8-443f-b701-a1b24623f71c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.155372 Aug 29 22:45:33.529168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 104/219] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:45:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:45:33.543017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8cd0546d-a0d7-4713-81cb-d6ec05eb2943 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:33.544114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8cd0546d-a0d7-4713-81cb-d6ec05eb2943 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:33.640909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8cd0546d-a0d7-4713-81cb-d6ec05eb2943 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:33.649701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8cd0546d-a0d7-4713-81cb-d6ec05eb2943 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1240 microversion: 2.1 time: 0.112860 Aug 29 22:45:33.650971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 105/220] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:33.711468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:33.720906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4277adce-f1e4-4aea-a736-aa5808019249 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.233874 Aug 29 22:45:33.732563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 116/221] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:33 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:34.676518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-289d551d-d5bd-4e8a-8914-5ad8adfb1303 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:34.677131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-289d551d-d5bd-4e8a-8914-5ad8adfb1303 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:34.738578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-289d551d-d5bd-4e8a-8914-5ad8adfb1303 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:34.742464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:34.743214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:34.746595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-289d551d-d5bd-4e8a-8914-5ad8adfb1303 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1240 microversion: 2.1 time: 0.073718 Aug 29 22:45:34.747536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 106/222] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:34.749762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:34.750280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:34.750742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:34.751422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:34.751884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:34.752337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:34.892605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:34.905167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e6ca3b47-37d8-47d3-bbae-d9efc49a4bc0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.162955 Aug 29 22:45:34.905167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 117/223] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:34 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:35.774938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:35.775553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:35.782750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:35.783688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:35.784157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:35.784904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:35.785358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:35.789891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:35.857401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:35.865611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-439ed23c-b5b8-4666-98a2-22ded7144ba9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1244 microversion: 2.1 time: 0.095353 Aug 29 22:45:35.866183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 107/224] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:35.924593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:35.925227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:35.931775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:35.932267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:35.932761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:35.933482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:35.934020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:35.934506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:36.089151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:36.097242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f938e8c6-b11a-447c-bcb0-0dcf0d36b690 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.176427 Aug 29 22:45:36.102892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 118/225] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:35 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:36.888512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:36.889441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:36.896192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:36.896683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:36.897150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:36.897909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:36.899069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:36.899683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:37.001398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:37.019511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-01a5ff22-26e3-4d33-8beb-2b5ce5b94691 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1292 microversion: 2.1 time: 0.128584 Aug 29 22:45:37.019511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 108/226] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1292 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:37.122874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:37.124210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:37.130602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:37.131094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:37.131640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:37.132386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:37.133434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:37.133845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:37.329968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:37.345360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6d3ad9ed-4506-4c16-883e-93d941ebac5c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.219736 Aug 29 22:45:37.345360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 119/227] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:37 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:38.039184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:38.040302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:38.047172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:38.049768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:38.050325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:38.051135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:38.051664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:38.052372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:38.178736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:38.198757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cdb5f699-0022-43b6-adc2-a9a69cf077df tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1292 microversion: 2.1 time: 0.163640 Aug 29 22:45:38.199833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 109/228] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1292 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:38.361243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:38.362193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:38.369634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:38.370588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:38.371112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:38.372901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:38.373686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:38.374397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:38.579340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:38.588065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0d04d5fd-b021-4f49-92e8-365edbdd6cfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1522 microversion: 2.1 time: 0.230885 Aug 29 22:45:38.588668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 120/229] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:38 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:39.223260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:39.224015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:39.235116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:39.236887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:39.237659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:39.238628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:39.245193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:39.245193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:39.329432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:39.339174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b3a8bb3a-d8b0-492c-b33f-012788649052 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1300 microversion: 2.1 time: 0.121564 Aug 29 22:45:39.353419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 110/230] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:39.610555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:39.611330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:39.619662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:39.620184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:39.622140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:39.622140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:39.622140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:39.622140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:39.905358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:39.913905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6127ba7e-12a2-4018-843a-f347d95e575e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1502 microversion: 2.1 time: 0.307000 Aug 29 22:45:39.931402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 121/231] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:39 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1502 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:39.935884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:39.936627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:39.972677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:39.973225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:39.975387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:39.976168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:39.976676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:39.978472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:40.310417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:40.321446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-84269af2-1f52-4708-aeb0-fe5e644c2e9d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1515 microversion: 2.1 time: 0.390437 Aug 29 22:45:40.342260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 111/232] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:39 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:40.363167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:40.364066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:40.373741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:40.376373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:40.377004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:40.379168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:40.379820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:40.380626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:40.721317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:40.731814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cf08fe0e-20e8-42b1-aff4-1f9ea248ea82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1366 microversion: 2.1 time: 0.372733 Aug 29 22:45:40.743319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 122/233] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:40 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:41.754868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:41.755894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:41.769723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:41.770219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:41.770705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:41.771583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:41.771904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:41.772499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:41.978406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:41.982434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-324bd65c-c01b-412e-af4d-d52d0d5fdf35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1366 microversion: 2.1 time: 0.231346 Aug 29 22:45:41.983025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 112/234] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:42.541191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-7d02e2da-9aeb-4ad9-bc99-26bba49c605e req-2c01a82a-7bf8-4014-83c4-33b24ebb0604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50bc49c0-59c8-4adc-9c9a-a43adb38c922", "tag": "3230f74d-5d52-4d21-bcb2-a8da0c68daca"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:42.589063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-7d02e2da-9aeb-4ad9-bc99-26bba49c605e req-2c01a82a-7bf8-4014-83c4-33b24ebb0604 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:42.590872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-7d02e2da-9aeb-4ad9-bc99-26bba49c605e req-2c01a82a-7bf8-4014-83c4-33b24ebb0604 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:42.592371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-7d02e2da-9aeb-4ad9-bc99-26bba49c605e req-2c01a82a-7bf8-4014-83c4-33b24ebb0604 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:42.622460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-7d02e2da-9aeb-4ad9-bc99-26bba49c605e req-2c01a82a-7bf8-4014-83c4-33b24ebb0604 service nova] Creating event network-changed:3230f74d-5d52-4d21-bcb2-a8da0c68daca for instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 on hv-cinder-85426 Aug 29 22:45:42.629380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-7d02e2da-9aeb-4ad9-bc99-26bba49c605e req-2c01a82a-7bf8-4014-83c4-33b24ebb0604 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100637 Aug 29 22:45:42.641625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 123/235] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:42.714359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:42.720671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:42.740398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:42.740889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:42.741543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:42.742953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:42.743871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:42.744930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:42.790796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lazy-loading 'flavor' on Instance uuid 91aa52d5-e323-47c3-b4ea-6f4391575689 {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:45:43.005347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:43.006096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:43.013855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:43.014349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:43.014783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:43.015480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:43.015931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:43.016396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:43.181847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f647b3bc-78d2-429b-bddd-356b89b2159f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689/action" status: 200 len: 32 microversion: 2.1 time: 0.474953 Aug 29 22:45:43.182728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 113/236] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:45:42 2022] POST /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689/action => generated 32 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:45:43.197991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:43.207367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:43.217472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:43.218312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:43.218926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:43.219857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:43.220546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:43.222238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:43.281674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:43.287729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:43.304949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1f2daa4e-5ba8-4d0a-b550-f6970c18622c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1366 microversion: 2.1 time: 0.304252 Aug 29 22:45:43.305634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 124/237] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:43.456913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:43.467366 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-256bf219-8eb0-4583-b5bc-fc1f52e93413 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.277173 Aug 29 22:45:43.467971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 114/238] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:43 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:44.332864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:44.332864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:44.348386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:44.391233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:44.392826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:44.396521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:44.399636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:44.401819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:44.492693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:44.493998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:44.502135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:44.502633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:44.503068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:44.503932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:44.504469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:44.505055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:44.742687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=14 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:44.843053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:44.853634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-80adafd6-d192-4370-80d2-2ef75949bd46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1366 microversion: 2.1 time: 0.529075 Aug 29 22:45:44.854242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 125/239] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1366 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:44.971974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:44.982522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1a5fa6c4-d076-4b37-95c9-7fd760e01f10 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.496806 Aug 29 22:45:44.989433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 115/240] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:44 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:45.890557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:45.894773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:45.911630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=38 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:45.938516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:45.946392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:45.949310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:45.951547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:45.953927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:45.956633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:46.006122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:46.006857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:46.021466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:46.026014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:46.026728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:46.028972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:46.029685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:46.032903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:46.499049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:46.529832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e107e510-8729-464d-81a2-6e387cdd2630 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1366 microversion: 2.1 time: 0.656027 Aug 29 22:45:46.546293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 126/241] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1366 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:46.645527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:46.667612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e76ece4d-a7c5-4c22-8bae-9dfc667c7fce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.657391 Aug 29 22:45:46.668758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 116/242] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:46 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:47.571973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:47.573097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:47.611159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:47.612057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:47.624315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:47.630181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:47.634023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:47.635191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:47.700279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:47.701618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:47.739435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:47.740839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:47.742455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:47.744362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:47.746469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:47.747499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:47.773712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:48.256180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:48.280524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-95b19694-9363-442a-bab3-936c53e9a59f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.590117 Aug 29 22:45:48.282765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 117/243] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:47 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:48.308352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-42792291-fddf-49ef-9168-16ff682303f1 req-1fdb9419-f0d4-43f4-a0e4-e0db9e0801c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bc49c0-59c8-4adc-9c9a-a43adb38c922", "name": "network-vif-plugged", "status": "completed", "tag": "3230f74d-5d52-4d21-bcb2-a8da0c68daca"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:48.359072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-42792291-fddf-49ef-9168-16ff682303f1 req-1fdb9419-f0d4-43f4-a0e4-e0db9e0801c8 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:48.360609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-42792291-fddf-49ef-9168-16ff682303f1 req-1fdb9419-f0d4-43f4-a0e4-e0db9e0801c8 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:48.363557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-42792291-fddf-49ef-9168-16ff682303f1 req-1fdb9419-f0d4-43f4-a0e4-e0db9e0801c8 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:48.415225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-42792291-fddf-49ef-9168-16ff682303f1 req-1fdb9419-f0d4-43f4-a0e4-e0db9e0801c8 service nova] Creating event network-vif-plugged:3230f74d-5d52-4d21-bcb2-a8da0c68daca for instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 on hv-cinder-85426 Aug 29 22:45:48.428017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-42792291-fddf-49ef-9168-16ff682303f1 req-1fdb9419-f0d4-43f4-a0e4-e0db9e0801c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128220 Aug 29 22:45:48.430827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 118/244] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:48.607252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:48.615894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f8b56af9-a872-425c-9eee-e8df719de64f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1366 microversion: 2.1 time: 1.051573 Aug 29 22:45:48.619713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 127/245] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1366 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:45:49.316009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:49.319312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:49.364883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.365406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.405717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.422108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.423942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.424810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.660060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:49.660060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:49.670643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.673884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.680397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.681833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:49.682805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:49.684191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:49.923686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:49.941046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-972ba68d-8fbe-4341-b29e-f96985a338e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.636498 Aug 29 22:45:49.941639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 119/246] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:49 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:50.232660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:50.249124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5f1dfbe1-fc4a-4e60-a186-d701dafba3f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1366 microversion: 2.1 time: 0.605308 Aug 29 22:45:50.253083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 128/247] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1366 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:50.678819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6ac9e2c6-fa20-444c-9c73-080aad1267c7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:50.681198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6ac9e2c6-fa20-444c-9c73-080aad1267c7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:50.711214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ac9e2c6-fa20-444c-9c73-080aad1267c7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:50.713874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ac9e2c6-fa20-444c-9c73-080aad1267c7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:50.715041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ac9e2c6-fa20-444c-9c73-080aad1267c7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:50.719507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ac9e2c6-fa20-444c-9c73-080aad1267c7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:50.720921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ac9e2c6-fa20-444c-9c73-080aad1267c7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:50.722161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ac9e2c6-fa20-444c-9c73-080aad1267c7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:50.777769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6ac9e2c6-fa20-444c-9c73-080aad1267c7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/ips" status: 200 len: 147 microversion: 2.1 time: 0.106956 Aug 29 22:45:50.785667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 120/248] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 22:45:50 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/ips => generated 147 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:50.996717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:50.998296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:51.006790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.008782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.009639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.011440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.012055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.012831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.136252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4eea977e-600e-4416-be13-f50a13b13806 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:51.137022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4eea977e-600e-4416-be13-f50a13b13806 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:51.164086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4eea977e-600e-4416-be13-f50a13b13806 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.164635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4eea977e-600e-4416-be13-f50a13b13806 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.175198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4eea977e-600e-4416-be13-f50a13b13806 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.176338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4eea977e-600e-4416-be13-f50a13b13806 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.176973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4eea977e-600e-4416-be13-f50a13b13806 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.178207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4eea977e-600e-4416-be13-f50a13b13806 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.275070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4eea977e-600e-4416-be13-f50a13b13806 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/ips" status: 200 len: 151 microversion: 2.20 time: 0.137045 Aug 29 22:45:51.282125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 121/249] 10.222.0.59 () {60 vars in 1289 bytes} [Mon Aug 29 22:45:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/ips => generated 151 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:45:51.296244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:51.296879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:51.311440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.311951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.312410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.317406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.317892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.318326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.450365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:51.455269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a0137602-bb22-4faa-b2ac-5664c5c05086 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.470240 Aug 29 22:45:51.456174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 129/250] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:50 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:51.589912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:51.601673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b0dbe43f-1f27-454e-bc17-72ca885e4b14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1555 microversion: 2.1 time: 0.310257 Aug 29 22:45:51.617394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 122/251] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1555 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:51.629966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-89854d7c-af42-42bb-ab9c-3909b42dce6b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:51.630463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-89854d7c-af42-42bb-ab9c-3909b42dce6b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:51.637668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89854d7c-af42-42bb-ab9c-3909b42dce6b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.638160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89854d7c-af42-42bb-ab9c-3909b42dce6b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.638593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89854d7c-af42-42bb-ab9c-3909b42dce6b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.639301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89854d7c-af42-42bb-ab9c-3909b42dce6b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:51.639837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89854d7c-af42-42bb-ab9c-3909b42dce6b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:51.643218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89854d7c-af42-42bb-ab9c-3909b42dce6b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:51.650171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:45:51.798817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-89854d7c-af42-42bb-ab9c-3909b42dce6b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172724 Aug 29 22:45:51.799836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 130/252] 10.222.0.59 () {58 vars in 1275 bytes} [Mon Aug 29 22:45:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:52.482487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:52.483152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:52.499459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:52.499970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:52.500443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:52.502269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:52.504475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:52.506372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:53.020505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:53.032794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6b8ef4d4-62ea-47cd-b4e4-17e24411db22 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.558124 Aug 29 22:45:53.033552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 123/253] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:52 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:53.674974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-3d6a001d-9669-4886-9a32-e17d30e5d476 req-5c2f9dd3-87d9-4063-9706-d1baec1b6424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50bc49c0-59c8-4adc-9c9a-a43adb38c922", "tag": "3230f74d-5d52-4d21-bcb2-a8da0c68daca"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:53.686190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-3d6a001d-9669-4886-9a32-e17d30e5d476 req-5c2f9dd3-87d9-4063-9706-d1baec1b6424 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:53.686791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-3d6a001d-9669-4886-9a32-e17d30e5d476 req-5c2f9dd3-87d9-4063-9706-d1baec1b6424 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:53.687313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-3d6a001d-9669-4886-9a32-e17d30e5d476 req-5c2f9dd3-87d9-4063-9706-d1baec1b6424 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:53.702210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-3d6a001d-9669-4886-9a32-e17d30e5d476 req-5c2f9dd3-87d9-4063-9706-d1baec1b6424 service nova] Creating event network-changed:3230f74d-5d52-4d21-bcb2-a8da0c68daca for instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 on hv-cinder-85426 Aug 29 22:45:53.730152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-3d6a001d-9669-4886-9a32-e17d30e5d476 req-5c2f9dd3-87d9-4063-9706-d1baec1b6424 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054593 Aug 29 22:45:53.730152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 131/254] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:54.263254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:54.263254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:54.263254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:54.263254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:54.265395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:54.265395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:54.265395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:54.265395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:54.287737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:54.301394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ce049616-4294-424c-a04b-ac8c0f7cf3fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.247490 Aug 29 22:45:54.302445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 124/255] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:54 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:54.382092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:54.386414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:54.410169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:54.410663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:54.411091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:54.411890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:54.412321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:54.412697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:54.496879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lazy-loading 'flavor' on Instance uuid 7e568957-b28a-4d75-b458-3f8e95bb38d0 {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:45:55.333553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:55.334176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:55.345531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:55.346035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:55.354636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:55.356731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:55.358894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:55.359538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:55.640993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7ea2fb56-7a8a-470c-94f9-d853b84d86a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "POST /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/action" status: 202 len: 0 microversion: 2.20 time: 1.264174 Aug 29 22:45:55.641684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 132/256] 10.222.0.59 () {62 vars in 1319 bytes} [Mon Aug 29 22:45:54 2022] POST /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/action => generated 0 bytes in 1266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:45:55.666927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:55.671536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:55.692279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:55.693215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:55.693881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:55.695257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:55.695909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:55.696397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:55.993787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:56.006056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:56.010513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:56.011957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-63dac6e1-af9d-4519-bd08-f54b5ab03625 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.358778 Aug 29 22:45:56.030402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 133/257] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:55 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:56.097131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:56.102742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fc3dc60f-b84c-49aa-8b68-0fbaf0540bce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.773637 Aug 29 22:45:56.126574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 125/258] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:55 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:56.566075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-48930433-fc1c-4766-b4f1-a55f6a66f2f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Action: 'create', calling method: .version_select at 0x7febd52cf430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1311812733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwN8ZZLk8PePuJ8L0+IEs4aP5o2omMpdoyNQT0KrTZXSiaNQHPbQ0xihCR89PfUti/xOdhhkyuMlo6ka4Jk2KQD8rzJznqE7p44qpAH1w/e/FaKcVEAQN0soHIGcWm5+Q=="}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:56.583620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-48930433-fc1c-4766-b4f1-a55f6a66f2f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Getting quotas for project f42dbdfe1c064b2080b48f8d40a4638b. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:45:56.588003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-48930433-fc1c-4766-b4f1-a55f6a66f2f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Getting quotas for user 21feac769b4b48508163f535cdedfbe5 and project f42dbdfe1c064b2080b48f8d40a4638b. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:45:56.788871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-48930433-fc1c-4766-b4f1-a55f6a66f2f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.421930 Aug 29 22:45:56.801217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 134/259] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 22:45:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:57.042713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:57.043562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:57.064165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.067755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.068569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.070268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.072858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.074950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.141191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:57.141809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:57.152570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.153120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.154210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.160667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.161151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.161580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.323535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:57.343701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:57.347074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:57.349232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-47e965f4-ab5b-46bd-aef6-f2935e9fb38a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.312398 Aug 29 22:45:57.365079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 126/260] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:57.371555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-71a195ad-8261-4a19-8c0d-8766520082a9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8ce7311-ed29-4eed-99cb-3d756a0af62a"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:45:57.374056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-71a195ad-8261-4a19-8c0d-8766520082a9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:57.380327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71a195ad-8261-4a19-8c0d-8766520082a9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.381056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71a195ad-8261-4a19-8c0d-8766520082a9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.381683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71a195ad-8261-4a19-8c0d-8766520082a9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.382599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71a195ad-8261-4a19-8c0d-8766520082a9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:57.383218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71a195ad-8261-4a19-8c0d-8766520082a9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:57.383801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71a195ad-8261-4a19-8c0d-8766520082a9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:57.424784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:57.435052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9864cf84-1521-4d04-8297-b5f9855decd1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.297864 Aug 29 22:45:57.436198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 135/261] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:57 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:58.375947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:58.376745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:58.383746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:58.384292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:58.384896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.385600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:58.386170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:58.386600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.567438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:58.576604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:58.578120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:58.579352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-332dba94-17c8-47fa-aa7e-fc6ed0f2d2db tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.208030 Aug 29 22:45:58.579930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 136/262] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:45:58.586594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:58.587450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:58.601671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:58.602170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:58.602642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.603358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:58.603807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:58.604367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:58.758452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-71a195ad-8261-4a19-8c0d-8766520082a9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.393465 Aug 29 22:45:58.759732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 127/263] 10.222.0.59 () {60 vars in 1323 bytes} [Mon Aug 29 22:45:57 2022] POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/os-volume_attachments => generated 194 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:45:58.765990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:58.786782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-87fbe592-6fcd-400c-b20d-7436ecadea63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.205502 Aug 29 22:45:58.787506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 137/264] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:58 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:45:59.612458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:59.612458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:59.613362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.613825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.614250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.615099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.615383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.615799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.784409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:59.792973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:59.794916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:45:59.804691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1d6c117c-541e-4799-a3d2-6449d1a0b5f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.202884 Aug 29 22:45:59.805895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 128/265] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:45:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:45:59.810785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:45:59.811389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:45:59.817768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.818195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.818623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.819904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:45:59.822093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:45:59.822729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:45:59.989530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:00.000072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d959111b-ec2c-4a87-a739-b993fb95aed9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.192958 Aug 29 22:46:00.000742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 138/266] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:45:59 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:00.834461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:00.835856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:00.842964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:00.843584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:00.844104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:00.844894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:00.845420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:00.845917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:00.989103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:00.997321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:00.998759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:00.999905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2455d202-b4a4-40ce-9895-d7c072342577 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.169700 Aug 29 22:46:01.000548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 129/267] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:01.021731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:01.022896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:01.029438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.029926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.030381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.031071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:01.031516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:01.031937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:01.181307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:01.200329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-358be010-b6fb-489d-bd80-2f5cede34c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.182540 Aug 29 22:46:01.200955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 139/268] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:01 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:02.024749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:02.026535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:02.032052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:02.032578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:02.033014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:02.034016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:02.034702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:02.035311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:02.204868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:02.214587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:02.216968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:02.218417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d261c040-2439-4616-8003-18f856a419fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.199071 Aug 29 22:46:02.219672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 130/269] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:02.238101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:02.238755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:02.245991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:02.246474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:02.246908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:02.249090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:02.249090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:02.249090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:02.598733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:02.610370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-80e87b13-7628-45c5-923b-1e1fcb61d524 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.391372 Aug 29 22:46:02.611134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 140/270] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:02 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:03.243022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:03.243647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:03.246269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:03.264460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:03.264975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:03.265431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:03.266187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:03.266657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:03.267169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:03.461761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:03.476897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:03.478794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:03.479963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c2f4be37-02d5-4879-98e9-78e204dfc2b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.241567 Aug 29 22:46:03.490409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 131/271] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:03.631928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:03.632730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:03.638805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:03.639298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:03.639709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:03.640474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:03.640926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:03.641342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:03.781164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:03.792408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-102e4ce2-d3c1-48bb-8d91-27449ab4644d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.164239 Aug 29 22:46:03.792995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 141/272] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:03 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:04.504718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:04.505510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:04.512685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:04.513169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:04.513646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:04.514551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:04.515171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:04.515585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:04.674895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:04.684449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:04.685914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:04.687077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-391c7960-beb5-452f-b949-ba6cefeddf81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.186420 Aug 29 22:46:04.687638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 132/273] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:04.814352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:04.815031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:04.821482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:04.821967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:04.822398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:04.823101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:04.823618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:04.824032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.047692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:05.055872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f8489169-a619-4420-89c5-e92bc72661ae tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1501 microversion: 2.1 time: 0.245638 Aug 29 22:46:05.056477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 142/274] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:04 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:05.079113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37be0548-c040-47c5-98be-a97551722dc2"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:05.082684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:05.090190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.091679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.092962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.093854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.094471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.094916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.122937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] HTTP exception thrown: Cannot 'attach_volume' instance 91aa52d5-e323-47c3-b4ea-6f4391575689 while it is in vm_state rescued Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Request method failure captured: Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: POST /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689/os-volume_attachments HTTP/1.1 Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 74 Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUEw39NdTrxy5ryUt7omGBmI5smeJUc6U5eIQs41bdzVIByqPiCTClAVg1N75emU49t-aXJl3Vcrmpmm85kYfR_AR8Z9kJwiODBs4iNDGPP1tlx3n9rv2xGstyMmjtPKu_0hIY2-67xrpRyAazwfklpDKDMR7ps0Q4VwGdVpVV0pnkk Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 66de012537ed40e3bc233b80458bcfc4 Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 22:46:05.124958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_66de012537ed40e3bc233b80458bcfc4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 66de012537ed40e3bc233b80458bcfc4 Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-ServerRescueNegativeTestJSON-948463503-project Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: cc2f5c40aedf47dcb6374d64fcb04add Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948463503-project Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {"volumeAttachment": {"volumeId": "37be0548-c040-47c5-98be-a97551722dc2"}} Aug 29 22:46:05.126287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Cannot 'attach_volume' instance 91aa52d5-e323-47c3-b4ea-6f4391575689 while it is in vm_state rescued Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'server_id': '91aa52d5-e323-47c3-b4ea-6f4391575689', 'body': {'volumeAttachment': {'volumeId': '37be0548-c040-47c5-98be-a97551722dc2'}}} Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91aa52d5-e323-47c3-b4ea-6f4391575689 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:46:05.127012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 91aa52d5-e323-47c3-b4ea-6f4391575689 while it is in vm_state rescued Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:46:05.128171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:46:05.129253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:46:05.129253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:46:05.129253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 91aa52d5-e323-47c3-b4ea-6f4391575689 while it is in vm_state rescued Aug 29 22:46:05.129253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:46:05.129253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Returning 409 to user: Cannot 'attach_volume' instance 91aa52d5-e323-47c3-b4ea-6f4391575689 while it is in vm_state rescued {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:46:05.129253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ebfbcd77-e15d-4989-99c2-d7ef6d148b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053637 Aug 29 22:46:05.129253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 133/275] 10.222.0.59 () {60 vars in 1323 bytes} [Mon Aug 29 22:46:05 2022] POST /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 22:46:05.137222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-59cc668f-6152-4c36-a4d4-a043c12f1a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:05.137835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-59cc668f-6152-4c36-a4d4-a043c12f1a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:05.143761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59cc668f-6152-4c36-a4d4-a043c12f1a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.144403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59cc668f-6152-4c36-a4d4-a043c12f1a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.144897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59cc668f-6152-4c36-a4d4-a043c12f1a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.145643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59cc668f-6152-4c36-a4d4-a043c12f1a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.146161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59cc668f-6152-4c36-a4d4-a043c12f1a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.146663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59cc668f-6152-4c36-a4d4-a043c12f1a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.424641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-59cc668f-6152-4c36-a4d4-a043c12f1a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689/action" status: 202 len: 0 microversion: 2.1 time: 0.291049 Aug 29 22:46:05.434295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 143/276] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:46:05 2022] POST /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:46:05.440268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:05.440831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:05.450489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.454051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.461309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.462519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.463182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.463798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.470166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:05.643231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:05.651645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-646a0b23-7b6a-435b-90f3-60be1d18bdec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1509 microversion: 2.1 time: 0.215705 Aug 29 22:46:05.652918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 134/277] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:05 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:05.718647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:05.719505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:05.727502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.728848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.729580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.730570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:05.731127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:05.732256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:05.895389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:05.904123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:05.905645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:05.906830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-01dd9b76-1158-44b7-9abf-6fa647acee7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.197387 Aug 29 22:46:05.907387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 144/278] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:06.675683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:06.677638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:06.692339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:06.693902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:06.695457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:06.697202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:06.698220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:06.699166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:06.704990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4599fafb-77b3-4157-8553-be040a752763 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:06.707371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=4 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:06.712948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4599fafb-77b3-4157-8553-be040a752763 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:06.715090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4599fafb-77b3-4157-8553-be040a752763 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:06.715090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4599fafb-77b3-4157-8553-be040a752763 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:06.783530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4599fafb-77b3-4157-8553-be040a752763 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Going to try to stop instance {{(pid=128150) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 22:46:06.788731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:06.852749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:06.860490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d865e7bb-062a-48a2-9eaf-24dade74e331 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1509 microversion: 2.1 time: 0.189315 Aug 29 22:46:06.861018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 135/279] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:06 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:06.932301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:06.932829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:06.939053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:06.939532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:06.939959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:06.940686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:06.941133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:06.941546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:07.034148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4599fafb-77b3-4157-8553-be040a752763 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/action" status: 202 len: 0 microversion: 2.1 time: 0.332872 Aug 29 22:46:07.036042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 145/280] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:46:06 2022] POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:46:07.049796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:07.050859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:07.059335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:07.060031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:07.060567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:07.061346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:07.062017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:07.062673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:07.101628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:07.114354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:07.116103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:07.117509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-96941923-985b-47fb-b7a0-5afda14cb5cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.190719 Aug 29 22:46:07.118066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 136/281] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:07.247629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:07.257034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3ccd2e79-a62d-4780-b334-49136378dec9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.215123 Aug 29 22:46:07.260901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 146/282] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:07 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:07.883394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:07.884023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:07.891676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:07.892126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:07.892589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:07.893315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:07.893769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:07.894194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:08.048058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:08.056930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-13eaa6b4-472f-49ec-8ca0-d6c1581c812c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1509 microversion: 2.1 time: 0.178555 Aug 29 22:46:08.057568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 137/283] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:07 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:08.140399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:08.141014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:08.148202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:08.148693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:08.149621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:08.149867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:08.150326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:08.150749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:08.283584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:08.284994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:08.292298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:08.293313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:08.293959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:08.297334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:08.297334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:08.297334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:08.297334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:08.301426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:08.302896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:08.304192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fa7b1252-1dc3-4884-a859-18192697b2c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.168097 Aug 29 22:46:08.304690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 147/284] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:08.436556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:08.444830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-353f688b-f928-4a9d-82af-b0bf9c38f6d1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.166458 Aug 29 22:46:08.445390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 138/285] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:08 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:08.689159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-34294899", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "networks": [{"uuid": "bf386cf4-b44b-4dfd-9345-388c689ec005"}]}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:08.747594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] validate_networks() for [('bf386cf4-b44b-4dfd-9345-388c689ec005', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:46:09.079921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:09.082202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:09.095698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.096224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.096951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.098107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.099617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.100280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.163588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:46:09.164304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:46:09.164520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:46:09.164943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:46:09.165360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:46:09.175434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.175910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.176692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.177505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.177953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.178371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.198840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Getting quotas for project 2c0dcefe769247eaa49da038e336bc8a. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:46:09.203272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Getting quotas for user 484c09f238bd4b0d91b6aeaee913f7d5 and project 2c0dcefe769247eaa49da038e336bc8a. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:46:09.215806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:46:09.218279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:46:09.266603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:09.275234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-60c69d98-a34f-4d34-b98f-05f7ec12d693 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1515 microversion: 2.1 time: 0.200133 Aug 29 22:46:09.275869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 139/286] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:09 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:09.327030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:09.327722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:09.334317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.335685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.336273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.337108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.337686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.338178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.445061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6280d938-d7da-43af-8cc2-6c8a4f3d93d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760481 Aug 29 22:46:09.446863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 148/287] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:46:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:46:09.462893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a860e7b1-e2ac-4d8f-a0d1-ac90715fee5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:09.463891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a860e7b1-e2ac-4d8f-a0d1-ac90715fee5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:09.507552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:09.532965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:09.537249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:09.537425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a860e7b1-e2ac-4d8f-a0d1-ac90715fee5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:09.540029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e43db765-b9b2-4795-884d-66f6b3e9e839 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.216866 Aug 29 22:46:09.544192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 140/288] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:09.546329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a860e7b1-e2ac-4d8f-a0d1-ac90715fee5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1217 microversion: 2.1 time: 0.091816 Aug 29 22:46:09.546907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 149/289] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:09 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:09.561577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:09.562280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:09.568309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.568785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.569377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.570365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:09.570815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:09.571239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:09.720840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:09.730668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-abeb1f00-34d3-4505-bec9-0aeb0fad52f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.188537 Aug 29 22:46:09.731257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 141/290] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:09 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:10.564792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:10.565407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:10.567252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-949f8552-52f5-42e5-889b-83cb3657bc9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:10.567943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-949f8552-52f5-42e5-889b-83cb3657bc9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:10.572669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:10.573198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:10.573601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:10.574404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:10.574864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:10.575315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:10.625121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-949f8552-52f5-42e5-889b-83cb3657bc9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:10.632759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-949f8552-52f5-42e5-889b-83cb3657bc9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1217 microversion: 2.1 time: 0.069279 Aug 29 22:46:10.633378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 142/291] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:10 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:10.713959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:10.723009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:10.724653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:10.726889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2cb78477-5fbc-4bed-80fc-151bf2636263 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.166455 Aug 29 22:46:10.727459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 150/292] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:10.753196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:10.753824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:10.761477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:10.761918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:10.762355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:10.763040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:10.763491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:10.763907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:10.909520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:10.918354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-28ec0602-7959-454a-bf09-514cfb590339 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.169111 Aug 29 22:46:10.918928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 143/293] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:10 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:11.080824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f46649e8-92cf-4c49-b13a-1d6a7b6041d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'create', calling method: .version_select at 0x7febd523e3a0>, body: {"keypair": {"name": "tempest-keypair-850289673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSkyc06rtBJV9Ky4Vrg6olh9cG9csYvjwjmGTw4/mo9anGAk5l+XQGsX53vhc0UQ+R/j3X8MkCSLa6bYahYBNyA5RFViknSu6yFOJudz2cSYdWlIZAZk7Jk+z4HpftXAA=="}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:11.101116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-f46649e8-92cf-4c49-b13a-1d6a7b6041d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Getting quotas for project 66de012537ed40e3bc233b80458bcfc4. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:46:11.106494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-f46649e8-92cf-4c49-b13a-1d6a7b6041d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Getting quotas for user cc2f5c40aedf47dcb6374d64fcb04add and project 66de012537ed40e3bc233b80458bcfc4. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:46:11.245681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f46649e8-92cf-4c49-b13a-1d6a7b6041d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168691 Aug 29 22:46:11.246128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 151/294] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 22:46:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:11.655187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:11.655629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:11.662279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:11.663357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:11.663993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:11.664872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:11.665325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:11.665749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:11.742859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:11.750561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:11.751165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-430b3589-6484-4af1-a245-fffdcc5766fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1269 microversion: 2.1 time: 0.099880 Aug 29 22:46:11.751273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:11.751361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 144/295] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:11 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:11.757507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:11.757997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:11.758428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:11.759131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:11.759585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:11.760014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:11.906553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:11.916733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:11.918444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:11.919974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d066debc-721f-49d3-b42f-9ae8cb1785ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1724 microversion: 2.20 time: 0.173417 Aug 29 22:46:11.920888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 152/296] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:11.940706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:11.941705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:11.949348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:11.949827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:11.950259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:11.950948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:11.951405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:11.951821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.115380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:12.125293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-53227a12-8f57-466a-902d-f93062eb561e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.188464 Aug 29 22:46:12.125873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 145/297] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:11 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:12.773539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:12.774366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:12.781630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.782135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.782563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.783320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.783769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.784219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.851324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:12.859920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-db7ae6db-5cab-40c6-b729-2942314f55ae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1277 microversion: 2.1 time: 0.091391 Aug 29 22:46:12.860942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 153/298] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:12 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:12.945599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:12.946513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:12.954408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.955027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.955773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.956588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.957110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.957665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.147004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:13.148170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:13.154791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.155580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.156237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.157047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.157686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.158341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.243189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:13.252210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:13.254060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:13.255253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8b893c9c-3809-418d-b432-55fce2a1987d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1745 microversion: 2.20 time: 0.315015 Aug 29 22:46:13.255810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 146/299] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1745 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:13.304962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:13.314804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cb51fc75-5d16-4733-8fd1-330aa05d19db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.171637 Aug 29 22:46:13.320403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 154/300] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:13 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:13.895196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:13.896415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:13.905851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.906334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.906760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.907622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.908070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.908515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.987130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:13.996745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6b89d3ab-508c-40f5-85d6-3afe754c637a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1275 microversion: 2.1 time: 0.109802 Aug 29 22:46:13.997271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 147/301] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:13 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:14.282869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:14.283717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:14.290643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:14.291171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:14.291602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:14.292357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:14.292787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:14.293203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:14.340435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:14.341144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:14.347540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:14.351230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:14.351230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:14.351230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:14.351230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:14.351543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:14.446757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:14.457566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:14.459051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:14.460841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-34bdf566-8cee-41f5-add4-4196f548a401 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1745 microversion: 2.20 time: 0.182364 Aug 29 22:46:14.461394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 155/302] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:14.652976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:14.664457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-75dde363-b8c4-4d80-a92e-060922548839 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.327029 Aug 29 22:46:14.667006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 148/303] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:14 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:14.667800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1787372591", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59f87ade-84a8-48d6-afc0-e65ac06d9bed"}], "security_groups": [{"name": "tempest-securitygroup--1093935354"}], "key_name": "tempest-keypair-850289673", "user_data": "}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:14.806822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] validate_networks() for [('59f87ade-84a8-48d6-afc0-e65ac06d9bed', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:46:15.020865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:15.021463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:15.030969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.031736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.032421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.033319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.033954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.034555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.239019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:46:15.239432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:46:15.239897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:46:15.240669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:46:15.241633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:46:15.243936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:15.244604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:15.252841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5cde5c49-7d0e-4553-bce0-5056c26676ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1317 microversion: 2.1 time: 0.236426 Aug 29 22:46:15.253025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.253473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.253881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 149/304] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:15 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:15.254011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.254589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.255037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.255449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.274444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Getting quotas for project 66de012537ed40e3bc233b80458bcfc4. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:46:15.278488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Getting quotas for user cc2f5c40aedf47dcb6374d64fcb04add and project 66de012537ed40e3bc233b80458bcfc4. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:46:15.290700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:46:15.296572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:46:15.389058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-ea717348-7bd6-4621-9c12-d6d10879a13f req-263ff60c-5255-48b8-8ffe-3223f47a4eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239", "tag": "f3dd0985-27c8-45ca-b9b5-2517ef13ed73"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:15.399217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-ea717348-7bd6-4621-9c12-d6d10879a13f req-263ff60c-5255-48b8-8ffe-3223f47a4eeb service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.399697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-ea717348-7bd6-4621-9c12-d6d10879a13f req-263ff60c-5255-48b8-8ffe-3223f47a4eeb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.400122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-ea717348-7bd6-4621-9c12-d6d10879a13f req-263ff60c-5255-48b8-8ffe-3223f47a4eeb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.411253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-ea717348-7bd6-4621-9c12-d6d10879a13f req-263ff60c-5255-48b8-8ffe-3223f47a4eeb service nova] Creating event network-changed:f3dd0985-27c8-45ca-b9b5-2517ef13ed73 for instance ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 on hv-cinder-85426 Aug 29 22:46:15.417402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-ea717348-7bd6-4621-9c12-d6d10879a13f req-263ff60c-5255-48b8-8ffe-3223f47a4eeb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032001 Aug 29 22:46:15.418099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 150/305] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:46:15.451826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-41d73543-d45f-4873-bfb9-11220742e755 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.790339 Aug 29 22:46:15.452574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 156/306] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:46:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:46:15.467040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f601ac95-44b9-4b28-bbc4-9faa7336196a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:15.468307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f601ac95-44b9-4b28-bbc4-9faa7336196a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:15.494287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:15.494813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:15.503000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.504328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.509092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.509092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.509092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.509092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.581918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f601ac95-44b9-4b28-bbc4-9faa7336196a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:15.600584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f601ac95-44b9-4b28-bbc4-9faa7336196a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1245 microversion: 2.1 time: 0.140152 Aug 29 22:46:15.601178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 151/307] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1245 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:15.666768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:15.680053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:15.681715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:15.686251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fc62d2af-4c4c-478f-9d3e-8e73d7549cc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1745 microversion: 2.20 time: 0.198032 Aug 29 22:46:15.696198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 157/308] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1745 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:15.711131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:15.712717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:15.723812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.727075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.727757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.728922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.729404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.729862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.790129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-a0ed275a-c5a8-4707-9e8d-482ce9a933ba req-3629b269-3337-423a-9305-13cebf8d2c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e568957-b28a-4d75-b458-3f8e95bb38d0", "name": "network-vif-plugged", "status": "completed", "tag": "2eaca61c-9e3d-41ec-b39b-74fe4d54599d"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:15.806741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-a0ed275a-c5a8-4707-9e8d-482ce9a933ba req-3629b269-3337-423a-9305-13cebf8d2c16 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:15.806741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-a0ed275a-c5a8-4707-9e8d-482ce9a933ba req-3629b269-3337-423a-9305-13cebf8d2c16 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:15.806741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-a0ed275a-c5a8-4707-9e8d-482ce9a933ba req-3629b269-3337-423a-9305-13cebf8d2c16 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:15.815433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-a0ed275a-c5a8-4707-9e8d-482ce9a933ba req-3629b269-3337-423a-9305-13cebf8d2c16 service nova] Creating event network-vif-plugged:2eaca61c-9e3d-41ec-b39b-74fe4d54599d for instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 on hv-cinder-85426 Aug 29 22:46:15.820441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-a0ed275a-c5a8-4707-9e8d-482ce9a933ba req-3629b269-3337-423a-9305-13cebf8d2c16 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 Aug 29 22:46:15.821485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 158/309] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:46:16.056631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:16.081267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aa83a8ef-3edc-4b73-b345-da481bec1878 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.392102 Aug 29 22:46:16.082043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 152/310] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:15 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:16.275877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:16.276630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:16.282983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.283465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.283891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.284608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.285052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.285536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.443202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:16.456950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cc6b20b0-8a1e-4cb7-b1fd-d020aad117bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1317 microversion: 2.1 time: 0.185937 Aug 29 22:46:16.464852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 159/311] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:16 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:16.622261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:16.622778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:16.628943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.629450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.632700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.632700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.632700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.632700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.653993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:16.717833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:16.718438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:16.724331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:16.733887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.734383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.734816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.735783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:16.736273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:16.736711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:16.737227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-46478e32-f669-43a3-8d3e-4c8d4b86337c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1249 microversion: 2.1 time: 0.119008 Aug 29 22:46:16.750835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 153/312] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1249 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:16.879767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:16.888613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:16.890192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:16.891340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f4afe513-bee6-4f4f-8774-b02cc5e7db65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.178189 Aug 29 22:46:16.891909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 160/313] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:17.105639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:17.106346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:17.112834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.113408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.114082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.115002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.115674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.117223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.271864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:17.281483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6e083b46-ef54-4504-85ab-04244fc4533e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.182090 Aug 29 22:46:17.292294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 154/314] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:17 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:17.479621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:17.480260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:17.486412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.486899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.487330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.488019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.488506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.488932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.634690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:17.645716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-94e988b8-dce9-47aa-9147-4ab80d777ae4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1317 microversion: 2.1 time: 0.170330 Aug 29 22:46:17.646490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 161/315] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:17 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:17.759804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:17.761017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:17.768206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.768965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.769601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.770576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.771263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.771894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.848718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:17.866381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-50fbcca3-e067-450b-8bc5-5eefdcebd41f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1249 microversion: 2.1 time: 0.111154 Aug 29 22:46:17.868557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 155/316] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1249 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:17.925825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:17.927581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:17.938776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.940071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.941178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:17.943541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:17.945463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:17.946087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:18.106392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:18.120875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:18.128320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:18.130872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1e2d4634-1968-4789-8473-813edf9a06d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.214207 Aug 29 22:46:18.133355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 162/317] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:18.302556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:18.303083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:18.311802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:18.312390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:18.312779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:18.313584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:18.313958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:18.314414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:18.495067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:18.509774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ea953f83-9d7a-4035-b8aa-acb4d185b057 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.210912 Aug 29 22:46:18.510351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 156/318] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:18 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:18.669319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:18.669941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:18.676649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:18.677131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:18.677615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:18.678305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:18.679074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:18.679492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:18.833569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:18.841970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4d538e32-90e7-4132-b013-7b06837eadd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1317 microversion: 2.1 time: 0.179033 Aug 29 22:46:18.842536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 163/319] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:18 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:18.902156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:18.905245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:18.926357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:18.927463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:18.928305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:18.929369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:18.932458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:18.932868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:19.020030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:19.029673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-54b072b2-ea32-4ceb-b8f2-e164704cc269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1297 microversion: 2.1 time: 0.135000 Aug 29 22:46:19.030541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 157/320] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1297 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:19.166598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:19.167716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:19.358700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:19.358700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:19.358700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:19.358700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:19.360079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:19.360079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:19.438460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:19.438460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:19.438806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:19.438806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5a3ac450-ef86-4df1-961c-89a86f166a72 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.273409 Aug 29 22:46:19.438806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 164/321] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:19.534127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:19.534729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:19.541916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:19.542412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:19.542858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:19.543573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:19.544029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:19.544482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:19.715645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:19.724431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b4329b48-ed9b-4103-8d9c-fb7c1158182e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.194963 Aug 29 22:46:19.725007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 158/322] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:19 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:19.870549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:19.871371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:19.884654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:19.885459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:19.885895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:19.887151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:19.887606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:19.888241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:19.909223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:20.051217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:20.052087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:20.058144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:20.068413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:20.069157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:20.069577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f3fb9451-de03-4a99-9246-f95f067e5360 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1317 microversion: 2.1 time: 0.206335 Aug 29 22:46:20.069848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:20.072215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 165/323] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:19 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:20.083450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:20.089392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:20.089854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:20.176909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:20.187782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6f701d7d-1b15-4c92-aef4-fc39e7f4e317 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1297 microversion: 2.1 time: 0.140432 Aug 29 22:46:20.189243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 159/324] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1297 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:20.467344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:20.468698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:20.522846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:20.523550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:20.524272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:20.525167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:20.525922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:20.526365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:20.727348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:20.736244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:20.737784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:20.739392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9b9098a0-e69a-44b4-94fe-b718baf87eee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.276518 Aug 29 22:46:20.739983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 166/325] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:20.752092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:20.759763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:20.763611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:20.764166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:20.764559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:20.765261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:20.765744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:20.766246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.003759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:21.024299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-781f8ebd-fb82-4187-9bef-73d03eeb61ea tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.276427 Aug 29 22:46:21.041337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 160/326] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:20 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:21.095281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:21.096061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:21.109528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.110560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.112639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.117611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.118354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.121651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.212126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:21.217019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:21.232859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.233644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.234261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.236082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.236783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.237424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.372499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:21.394631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-66f2bcbf-a490-44b7-ad22-6c5dfc0f1791 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1303 microversion: 2.1 time: 0.186511 Aug 29 22:46:21.398924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 161/327] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:21.448708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:21.459377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0de8889e-3e89-4a50-a4ca-0bbd75337f3a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1317 microversion: 2.1 time: 0.370141 Aug 29 22:46:21.467670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 167/328] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:21 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:21.495413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-64943790", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1311812733", "security_groups": [{"name": "tempest-secgroup-smoke-1814601197"}], "block_device_mapping_v2": [{"uuid": "e0116eab-822a-4ea4-a06b-4948d6afed1a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e25b134-a043-4f59-91eb-e46983b6f281"}]}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:21.763786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:21.764705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:21.781314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.782230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.782939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.784185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:21.785170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:21.785881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:21.993708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:22.019845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:22.021655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:22.024110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dd268036-b82f-41a2-9b51-e2e728f74cc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.264973 Aug 29 22:46:22.037597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 168/329] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:22.044792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-0fb221a8-2a7a-4ee2-b28f-5d36e5914357 req-f0bb97ff-5baf-4a9c-8ed4-764d93b32b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239", "name": "network-vif-plugged", "status": "completed", "tag": "f3dd0985-27c8-45ca-b9b5-2517ef13ed73"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:22.057428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-0fb221a8-2a7a-4ee2-b28f-5d36e5914357 req-f0bb97ff-5baf-4a9c-8ed4-764d93b32b43 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:22.063120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-0fb221a8-2a7a-4ee2-b28f-5d36e5914357 req-f0bb97ff-5baf-4a9c-8ed4-764d93b32b43 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:22.063120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-0fb221a8-2a7a-4ee2-b28f-5d36e5914357 req-f0bb97ff-5baf-4a9c-8ed4-764d93b32b43 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:22.074167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-0fb221a8-2a7a-4ee2-b28f-5d36e5914357 req-f0bb97ff-5baf-4a9c-8ed4-764d93b32b43 service nova] Creating event network-vif-plugged:f3dd0985-27c8-45ca-b9b5-2517ef13ed73 for instance ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 on hv-cinder-85426 Aug 29 22:46:22.081755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-0fb221a8-2a7a-4ee2-b28f-5d36e5914357 req-f0bb97ff-5baf-4a9c-8ed4-764d93b32b43 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042680 Aug 29 22:46:22.082593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 169/330] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:22.088861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:22.091564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:22.092785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.network.neutron [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] validate_networks() for [('0e25b134-a043-4f59-91eb-e46983b6f281', None, None, None, None, None)] {{(pid=128151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:46:22.097687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:22.109630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:22.110467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:22.111731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:22.112638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:22.123687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:22.353952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:22.366290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-41496ee2-677a-4ba4-9ddf-4709f609ea4d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.281978 Aug 29 22:46:22.367582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 170/331] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:22 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:22.422122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:22.424419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:22.440956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:22.441798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:22.442433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:22.442933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:22.443441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:22.443872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:22.707227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:22.720118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a7d463ca-a030-41f5-9d19-d40b14e2926a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.303374 Aug 29 22:46:22.726200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 171/332] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:22.739575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:22.741196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:22.759055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:22.759055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:22.759372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:22.760178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:22.761139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:22.761596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:22.949830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:22.961066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3e9bc238-101f-4025-8223-5c2d652694a3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1317 microversion: 2.1 time: 0.232533 Aug 29 22:46:22.976767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 172/333] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:22 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:23.052576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Flavor limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:46:23.052576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Image limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:46:23.052576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Flavor pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:46:23.052576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Image pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:46:23.052576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:46:23.053056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:23.054036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:23.066707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.067528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.068331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.070101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.070917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.071610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.074952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.075457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.075907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.076743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.077205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.077642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.104982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Getting quotas for project f42dbdfe1c064b2080b48f8d40a4638b. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:46:23.120174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Getting quotas for user 21feac769b4b48508163f535cdedfbe5 and project f42dbdfe1c064b2080b48f8d40a4638b. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:46:23.198014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Going to run 1 instances... {{(pid=128151) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:46:23.201622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0116eab-822a-4ea4-a06b-4948d6afed1a',volume_size=None,volume_type=None)] {{(pid=128151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:46:23.274055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:23.283963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:23.285379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:23.286959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-181af75c-b49b-4b7a-997c-4a90e2b9cd3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.240428 Aug 29 22:46:23.288840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 173/334] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:23.397150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:23.399553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:23.411063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.411817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.412568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.415043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.415768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.416441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.582129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:23.600640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fe4c8518-3f59-409e-8e5b-2678c89ac353 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1725 microversion: 2.1 time: 0.210331 Aug 29 22:46:23.619237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 174/335] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:23 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:23.626541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-d21a4555-8f19-4c86-a0ae-2a5ed206bfc2 req-5f62b02f-f2d0-4f06-bcae-121083690cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a903cf9-0a2d-4391-ad67-ae87403930d7", "tag": "7f847326-2f84-445f-8fd3-98855eb599bf"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:23.638881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-d21a4555-8f19-4c86-a0ae-2a5ed206bfc2 req-5f62b02f-f2d0-4f06-bcae-121083690cb7 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.639432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-d21a4555-8f19-4c86-a0ae-2a5ed206bfc2 req-5f62b02f-f2d0-4f06-bcae-121083690cb7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.639930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-d21a4555-8f19-4c86-a0ae-2a5ed206bfc2 req-5f62b02f-f2d0-4f06-bcae-121083690cb7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.654967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-d21a4555-8f19-4c86-a0ae-2a5ed206bfc2 req-5f62b02f-f2d0-4f06-bcae-121083690cb7 service nova] Creating event network-changed:7f847326-2f84-445f-8fd3-98855eb599bf for instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 on hv-cinder-85426 Aug 29 22:46:23.660629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-d21a4555-8f19-4c86-a0ae-2a5ed206bfc2 req-5f62b02f-f2d0-4f06-bcae-121083690cb7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039238 Aug 29 22:46:23.661739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 175/336] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:23.754665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:23.755694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:23.763844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.764507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.765111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.766061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:23.766912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:23.767400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:23.841082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-45fcb970-07f7-443b-9fb4-2965b8657eb8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.349729 Aug 29 22:46:23.842028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 162/337] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:46:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:46:23.871617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-98fdee2c-795a-48d1-a1b3-d0258bce3796 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:23.873529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-98fdee2c-795a-48d1-a1b3-d0258bce3796 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:23.949499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:23.959452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-60992a47-f1b3-4a8a-8455-7e5953096658 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.209767 Aug 29 22:46:23.984163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 176/338] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:23.990668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-98fdee2c-795a-48d1-a1b3-d0258bce3796 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:23.999467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:24.000086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:24.000227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-98fdee2c-795a-48d1-a1b3-d0258bce3796 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1093 microversion: 2.1 time: 0.150895 Aug 29 22:46:24.001421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 163/339] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:23 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1093 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:24.011318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:24.023588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:24.023588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:24.023588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:24.023588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:24.023957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:24.313412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:24.314946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:24.338875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:24.339916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:24.340584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:24.341526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:24.344789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:24.345736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:24.743411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:24.755704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2404badf-8727-4d27-8dd9-d22d0ebf0f10 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1317 microversion: 2.1 time: 0.764356 Aug 29 22:46:24.769038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 177/340] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:23 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:24.775539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:24.776172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:24.791639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:24.792179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:24.792620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:24.793439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:24.794108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:24.794584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:24.844694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:24.869238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:24.871014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:24.872265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1ad9a6db-44df-4878-9a81-2ff954227faa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.563653 Aug 29 22:46:24.873118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 164/341] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:24.995590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:24.996626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:25.003202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.003995 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.005335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.006060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.006530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.007609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.008746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:25.022778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5e979498-d4e4-46ff-9461-78308c288d91 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1702 microversion: 2.1 time: 0.252403 Aug 29 22:46:25.024567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 178/342] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:24 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1702 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:25.031309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9907b152-679d-434c-bfa7-e96bdda37d77 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:25.032313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9907b152-679d-434c-bfa7-e96bdda37d77 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:25.094190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9907b152-679d-434c-bfa7-e96bdda37d77 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:25.101868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9907b152-679d-434c-bfa7-e96bdda37d77 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1093 microversion: 2.1 time: 0.075756 Aug 29 22:46:25.102469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 179/343] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:25.108172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-88c67b52-dfd0-411c-8165-8804e72d5377 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:25.114887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-88c67b52-dfd0-411c-8165-8804e72d5377 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.115527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-88c67b52-dfd0-411c-8165-8804e72d5377 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.116674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-88c67b52-dfd0-411c-8165-8804e72d5377 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.144724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-88c67b52-dfd0-411c-8165-8804e72d5377 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Going to try to start instance {{(pid=128150) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 22:46:25.265385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:25.265385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1b562d68-0e9a-4bc6-b995-d28e9c1ac667 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.262846 Aug 29 22:46:25.265385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 165/344] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:25.265743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=4 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:25.578166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-88c67b52-dfd0-411c-8165-8804e72d5377 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/action" status: 202 len: 0 microversion: 2.1 time: 0.474235 Aug 29 22:46:25.578778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 180/345] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:46:25 2022] POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:46:25.589611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:25.590240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:25.596690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.597473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.597933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.598683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.599162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.600179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.755209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:25.765989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e1b2fb19-169e-4a98-9d19-2fc696b24d98 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1711 microversion: 2.1 time: 0.182085 Aug 29 22:46:25.766956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 166/346] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:25 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1711 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:25.785121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:25.786187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:25.796122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.796821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.798771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.799530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.799997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.800589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.906895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:25.907559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:25.915113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.919051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.919051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.919051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.919051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.919413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.978596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:25.988332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2cbfe760-9c02-4a1d-add7-7d059bf862aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1506 microversion: 2.1 time: 0.208068 Aug 29 22:46:25.993619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 181/347] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:25 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:26.114428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:26.127667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:26.131352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:26.131352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cf805bed-cad0-40bb-b8f6-2bec526be4da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.235080 Aug 29 22:46:26.131352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 167/348] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:26.138398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:26.139284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:26.149695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:26.150293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:26.150627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:26.151472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:26.151832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:26.152289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:26.255550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:26.275786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ae0f957d-d46d-493e-a0be-f0e5de555948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1143 microversion: 2.1 time: 0.141219 Aug 29 22:46:26.276973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 182/349] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1143 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:26.300842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:26.302099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:26.309457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:26.310333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:26.311027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:26.311962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:26.312896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:26.313535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:26.491748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:26.501447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-60c2d482-05da-465c-a51b-ac3c51ddb8d1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.210229 Aug 29 22:46:26.516963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 168/350] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:26.790085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:26.790772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:26.811912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:26.815382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:26.815833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:26.816597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:26.824671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:26.830247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:26.895148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:27.156397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:27.160549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:27.174328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:27.175691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:27.177455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:27.183494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:27.183494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:27.183494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:27.195673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:27.205062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1007ba99-b4fc-4531-b4ac-9aa427a77bcd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1711 microversion: 2.1 time: 0.419801 Aug 29 22:46:27.221791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 183/351] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:26 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1711 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:27.301976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:27.303986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:27.313611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:27.314311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:27.315005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:27.315906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:27.316539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:27.317898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:27.437332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:27.454252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5a9d66cb-af0f-43e2-bc52-a0f1fc241d97 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1135 microversion: 2.1 time: 0.159752 Aug 29 22:46:27.455672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 184/352] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:27 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1135 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:27.526047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:27.527027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:27.538402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:27.540794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:27.542365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:27.544772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:27.549489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:27.549489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:27.627196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:27.661683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:27.673769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:27.677222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8c1632b0-82fc-44a0-baf6-666d478015bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.524791 Aug 29 22:46:27.685722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 169/353] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:27.910280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:27.936978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-99ef5e58-30fe-450b-aabe-18a2a07d48e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.406728 Aug 29 22:46:27.937829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 185/354] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:28.242389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:28.243985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:28.253883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:28.260937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.262035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.262735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.263422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.264117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.264975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.483074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:28.483689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:28.500119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:28.500301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.500301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.500656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.501427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.501878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.504193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.517158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9f669fd6-0895-4c0e-9453-b28a915754e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1711 microversion: 2.1 time: 0.289685 Aug 29 22:46:28.534269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 170/355] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:28 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1711 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:28.585186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:28.594484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dbbc74e2-ad91-4be9-8f21-4abcdd346661 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1191 microversion: 2.1 time: 0.115122 Aug 29 22:46:28.595411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 186/356] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:28 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:28.711350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:28.712002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:28.719410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.719940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.720412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.721787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.722390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.722856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.959606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:28.961312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:28.969172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.969663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.970093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.971042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:28.971632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:28.972063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:28.989205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:29.001925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:29.004173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:29.005640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:29.006887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82cc09e7-f7af-4e9e-afc3-1589dd1c7f0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.301209 Aug 29 22:46:29.020548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 171/357] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:29.253690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:29.264923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-478c8f4b-a365-4f29-9e88-adbc55c4623e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.309387 Aug 29 22:46:29.308043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 187/358] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:29.543919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:29.545013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:29.551744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:29.552290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:29.552772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:29.554104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:29.554986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:29.555578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:29.618394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:29.619013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:29.625757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:29.626232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:29.626668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:29.627471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:29.627930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:29.628396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:29.695684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:29.704417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:29.706147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6cde7e99-2dc3-4749-8bf8-a4691a1d054a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1209 microversion: 2.1 time: 0.091478 Aug 29 22:46:29.716193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 188/359] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:29 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:29.716431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-61ee7942-7999-4e24-a3d8-2d787f33f2f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1711 microversion: 2.1 time: 0.174942 Aug 29 22:46:29.716431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 172/360] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:29 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1711 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:30.032910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:30.033528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:30.039669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.040159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.040591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.041309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.041750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.042167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.181564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:30.190088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:30.191553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:30.192741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-49ca4ad6-eed1-4391-9e86-8fa1061d2d17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.163851 Aug 29 22:46:30.193287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 189/361] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:30.286223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:30.286890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:30.301493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.304864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.304864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.304864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.304864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.305487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.464687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:30.472287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3d20fe80-42b0-4a09-953b-20749a712443 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.190048 Aug 29 22:46:30.473107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 173/362] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:30.730987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:30.731915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:30.737996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:30.739024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:30.751229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.751771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.753710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.754919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.755419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.755856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.763787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.766619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.767438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.769502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:30.771556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:30.774015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:30.898097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:30.910719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5f470230-76c4-41c8-b56a-e2fc83b0c9fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1209 microversion: 2.1 time: 0.186086 Aug 29 22:46:30.911497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 190/363] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:30 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1209 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:31.002205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:31.020466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a33af3e5-13ab-4727-94b3-efb04693069f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1715 microversion: 2.1 time: 0.279879 Aug 29 22:46:31.021573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 174/364] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:30 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1715 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:31.217183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:31.217965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:31.224162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:31.224741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:31.225804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:31.226701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:31.227154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:31.227594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:31.381404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:31.390615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:31.392061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:31.393247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ce9631a9-cace-49ef-a012-c995e07c7b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1740 microversion: 2.20 time: 0.180468 Aug 29 22:46:31.393809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 191/365] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:31.498949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:31.499856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:31.507653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:31.507781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:31.508417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:31.509118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:31.509774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:31.510197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:31.682619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:31.690333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9ba6b640-934f-463b-8671-f7aa7c0f0cbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.195460 Aug 29 22:46:31.690918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 175/366] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:31.937062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:31.937681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:31.946068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:31.951077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:31.951077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:31.951077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:31.951077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:31.951505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:32.110055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:32.119796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d07e4918-db4c-4270-a4e4-05e92ce376ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.187296 Aug 29 22:46:32.132444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 192/367] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:31 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:32.132768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-7f601348-ab2d-42cc-ac7c-b6cc68447b84 req-8bdda430-e084-4214-8ed6-4cc7354fcc6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a903cf9-0a2d-4391-ad67-ae87403930d7", "name": "network-vif-plugged", "status": "completed", "tag": "7f847326-2f84-445f-8fd3-98855eb599bf"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:32.140565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-7f601348-ab2d-42cc-ac7c-b6cc68447b84 req-8bdda430-e084-4214-8ed6-4cc7354fcc6f service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:32.142663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-7f601348-ab2d-42cc-ac7c-b6cc68447b84 req-8bdda430-e084-4214-8ed6-4cc7354fcc6f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:32.142663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-7f601348-ab2d-42cc-ac7c-b6cc68447b84 req-8bdda430-e084-4214-8ed6-4cc7354fcc6f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:32.154957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-7f601348-ab2d-42cc-ac7c-b6cc68447b84 req-8bdda430-e084-4214-8ed6-4cc7354fcc6f service nova] Creating event network-vif-plugged:7f847326-2f84-445f-8fd3-98855eb599bf for instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 on hv-cinder-85426 Aug 29 22:46:32.160399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-7f601348-ab2d-42cc-ac7c-b6cc68447b84 req-8bdda430-e084-4214-8ed6-4cc7354fcc6f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040671 Aug 29 22:46:32.161286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 176/368] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:46:32.417309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:32.418062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:32.424195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:32.424695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:32.425125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:32.432276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:32.432276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:32.432276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:32.452609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-d88f3a15-d9a8-4e12-8c46-b76004cce49a req-8f412d93-603e-4d2b-9f57-a906bcbfdcbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b697cf12-f552-4b39-89fe-062c61614073", "tag": "ade16d2d-3668-4793-a70a-d4f465108efa"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:32.463703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-d88f3a15-d9a8-4e12-8c46-b76004cce49a req-8f412d93-603e-4d2b-9f57-a906bcbfdcbc service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:32.464635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-d88f3a15-d9a8-4e12-8c46-b76004cce49a req-8f412d93-603e-4d2b-9f57-a906bcbfdcbc service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:32.465053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-d88f3a15-d9a8-4e12-8c46-b76004cce49a req-8f412d93-603e-4d2b-9f57-a906bcbfdcbc service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:32.476611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-d88f3a15-d9a8-4e12-8c46-b76004cce49a req-8f412d93-603e-4d2b-9f57-a906bcbfdcbc service nova] Creating event network-changed:ade16d2d-3668-4793-a70a-d4f465108efa for instance b697cf12-f552-4b39-89fe-062c61614073 on hv-cinder-85426 Aug 29 22:46:32.481718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-d88f3a15-d9a8-4e12-8c46-b76004cce49a req-8f412d93-603e-4d2b-9f57-a906bcbfdcbc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033661 Aug 29 22:46:32.482541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 177/369] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:46:32.671643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:32.682688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:32.684757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:32.686112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-029b79f1-5527-4e10-b6ac-80d54e494aa4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1722 microversion: 2.20 time: 0.273485 Aug 29 22:46:32.686918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 193/370] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:32.713134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:32.713979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:32.721617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:32.722104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:32.722534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:32.723359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:32.723819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:32.724389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:32.952340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:32.960779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8aee8d57-9aaa-480f-ae95-9972a1c6e255 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.253037 Aug 29 22:46:32.961369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 178/371] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:33.147005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:33.147834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:33.156516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:33.157188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:33.157742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:33.158592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:33.159167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:33.159719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:33.373683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:33.386028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-966d8215-ada8-4529-8c31-f00c842a2a04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.245271 Aug 29 22:46:33.386633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 194/372] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:33 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:33.712066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:33.712697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:33.714655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:33.719939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:33.720448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:33.720886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:33.721566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:33.722018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:33.722437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:33.862637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:33.872403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:33.873850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:33.874997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-43055821-b1ab-4c9f-9de5-1381cc46b8e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1722 microversion: 2.20 time: 0.167809 Aug 29 22:46:33.875769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 179/373] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:33.982309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:33.982979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:33.989272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:33.989762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:33.993915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:33.993915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:33.993915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:33.993915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:34.210971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:34.220253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2d830044-f829-40c8-89df-263ffaf6359e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.241907 Aug 29 22:46:34.220836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 195/374] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:34.412076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:34.412787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:34.414742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=12 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:34.420099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:34.427016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:34.427016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:34.427016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:34.427016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:34.427402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:34.568515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:34.576506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-570b0e68-2952-4a55-ba58-64bada74f6aa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.168400 Aug 29 22:46:34.577128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 180/375] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:34 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:34.898033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:34.898655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:34.905836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:34.906322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:34.906752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:34.907446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:34.907895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:34.908353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:35.049000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:35.057315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:35.058779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:35.059953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ccd2228d-24a2-41b2-ba31-a309adf18f70 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1722 microversion: 2.20 time: 0.165867 Aug 29 22:46:35.060544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 196/376] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:35.244013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:35.244735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:35.252273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:35.252765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:35.253198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:35.253904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:35.254351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:35.254762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:35.392574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:35.400714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0fc7834a-61a2-416a-a27c-78860f78146c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.162611 Aug 29 22:46:35.401289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 181/377] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:35.597976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:35.598566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:35.600539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=20 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:35.605950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:35.606438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:35.606874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:35.607642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:35.608478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:35.608577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:35.748192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:35.756893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fe928fe5-26dd-4e5d-96c0-1419c7ce34bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.162848 Aug 29 22:46:35.757483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 197/378] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:35 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:36.083582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:36.084102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:36.091373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:36.091873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:36.092427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:36.093138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:36.093607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:36.094033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:36.232501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:36.240708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:36.242157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:36.243837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9585c563-64ae-44e4-8ce9-6e9993be8e89 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1722 microversion: 2.20 time: 0.164708 Aug 29 22:46:36.244419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 182/379] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:36.421996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:36.422609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:36.428997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:36.429481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:36.429909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:36.431375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:36.431829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:36.432274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:36.580347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:36.589094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-245d5748-9c54-4989-8aee-0bbd0708051a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1371 microversion: 2.1 time: 0.171089 Aug 29 22:46:36.589689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 198/380] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:36.778923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:36.779491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:36.786525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:36.787013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:36.787451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:36.788175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:36.788633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:36.789058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:36.937011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:36.945274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bb0f093a-3b0e-4dad-a68c-918f5682b586 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.170710 Aug 29 22:46:36.945848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 183/381] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:36 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:37.267572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:37.268201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:37.270224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:37.275691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.276193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.276648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:37.277454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.277909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.278350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:37.415460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:37.425769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:37.429070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:37.429070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-46a644d0-2467-4a19-9b7b-1f0207c3b0bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1722 microversion: 2.20 time: 0.164997 Aug 29 22:46:37.434319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 199/382] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:37.613899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:37.614734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:37.621784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.622266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.622692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:37.623380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.624572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.624572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:37.762389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:37.770143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2d6bc2c7-d0ac-400e-9a5a-08cec942f928 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1565 microversion: 2.1 time: 0.163181 Aug 29 22:46:37.772013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 184/383] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:37.791313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-10b513b3-2304-4f5c-8c82-54e10a902120 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:37.792026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-10b513b3-2304-4f5c-8c82-54e10a902120 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:37.798251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b513b3-2304-4f5c-8c82-54e10a902120 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.800857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b513b3-2304-4f5c-8c82-54e10a902120 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.800857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b513b3-2304-4f5c-8c82-54e10a902120 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:37.800857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b513b3-2304-4f5c-8c82-54e10a902120 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.800857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b513b3-2304-4f5c-8c82-54e10a902120 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.801253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b513b3-2304-4f5c-8c82-54e10a902120 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:37.804767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:37.883084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-10b513b3-2304-4f5c-8c82-54e10a902120 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095919 Aug 29 22:46:37.883674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 200/384] 10.222.0.59 () {58 vars in 1275 bytes} [Mon Aug 29 22:46:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:37.967743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:37.968454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:37.977973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.978645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.979100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:37.980036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:37.980611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:37.981046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:38.154321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-05112175-31ed-4047-b521-e352fb696ab5 req-4c7e1514-c0f9-4b1b-b9ec-4878efb419e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e568957-b28a-4d75-b458-3f8e95bb38d0", "name": "network-vif-unplugged", "status": "completed", "tag": "2eaca61c-9e3d-41ec-b39b-74fe4d54599d"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:38.164513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-05112175-31ed-4047-b521-e352fb696ab5 req-4c7e1514-c0f9-4b1b-b9ec-4878efb419e3 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:38.165823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-05112175-31ed-4047-b521-e352fb696ab5 req-4c7e1514-c0f9-4b1b-b9ec-4878efb419e3 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:38.166827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-05112175-31ed-4047-b521-e352fb696ab5 req-4c7e1514-c0f9-4b1b-b9ec-4878efb419e3 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:38.181587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-05112175-31ed-4047-b521-e352fb696ab5 req-4c7e1514-c0f9-4b1b-b9ec-4878efb419e3 service nova] Creating event network-vif-unplugged:2eaca61c-9e3d-41ec-b39b-74fe4d54599d for instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 on hv-cinder-85426 Aug 29 22:46:38.187274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-05112175-31ed-4047-b521-e352fb696ab5 req-4c7e1514-c0f9-4b1b-b9ec-4878efb419e3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037559 Aug 29 22:46:38.187879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 201/385] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:38.456614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:38.457415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:38.464441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:38.464936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:38.465519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:38.466225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:38.466682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:38.467107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:38.482269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:38.510964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-75a9e5b0-ed4c-4c94-85d5-47a4731ab00a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.547011 Aug 29 22:46:38.511628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 185/386] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:37 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:38.637211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:38.647591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:38.649848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:38.651081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e3dd4f5e-973b-41d9-aba6-181652f6f6b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1725 microversion: 2.20 time: 0.201288 Aug 29 22:46:38.662587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 202/387] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:38.674350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6b02c515-8db6-45e8-a03b-750c84502e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bebb25dc-f73a-45b8-a590-96b331454771"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:38.676759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6b02c515-8db6-45e8-a03b-750c84502e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:38.683442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b02c515-8db6-45e8-a03b-750c84502e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:38.683897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b02c515-8db6-45e8-a03b-750c84502e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:38.684356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b02c515-8db6-45e8-a03b-750c84502e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:38.685045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b02c515-8db6-45e8-a03b-750c84502e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:38.685492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b02c515-8db6-45e8-a03b-750c84502e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:38.685906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b02c515-8db6-45e8-a03b-750c84502e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:39.531695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:39.532372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:39.538792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:39.539279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:39.540271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:39.541184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:39.541638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:39.542055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:39.697549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:39.707204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a6e3de81-625d-4d9f-8a64-f0854141045c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.179495 Aug 29 22:46:39.718791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 203/388] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:39 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:39.718791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-1abec938-2146-415d-9883-4f71fcfee04b req-af51ee03-d415-4aad-96d0-70a56591b1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a903cf9-0a2d-4391-ad67-ae87403930d7", "tag": "7f847326-2f84-445f-8fd3-98855eb599bf"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:39.723578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-1abec938-2146-415d-9883-4f71fcfee04b req-af51ee03-d415-4aad-96d0-70a56591b1cb service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:39.724082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-1abec938-2146-415d-9883-4f71fcfee04b req-af51ee03-d415-4aad-96d0-70a56591b1cb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:39.724535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-1abec938-2146-415d-9883-4f71fcfee04b req-af51ee03-d415-4aad-96d0-70a56591b1cb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:39.740491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-1abec938-2146-415d-9883-4f71fcfee04b req-af51ee03-d415-4aad-96d0-70a56591b1cb service nova] Creating event network-changed:7f847326-2f84-445f-8fd3-98855eb599bf for instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 on hv-cinder-85426 Aug 29 22:46:39.746074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-1abec938-2146-415d-9883-4f71fcfee04b req-af51ee03-d415-4aad-96d0-70a56591b1cb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036475 Aug 29 22:46:39.746742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 204/389] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:40.076297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6b02c515-8db6-45e8-a03b-750c84502e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "POST /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.405790 Aug 29 22:46:40.077252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 186/390] 10.222.0.59 () {62 vars in 1364 bytes} [Mon Aug 29 22:46:38 2022] POST /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 188 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:46:40.249471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:40.250175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:40.256673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:40.257161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:40.257602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:40.258376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:40.259535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:40.260322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:40.309822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128150) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 22:46:40.729790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:40.730408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:40.737324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:40.737807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:40.738235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:40.738996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:40.739444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:40.739861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:40.744098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:40.765149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b2064110-45a9-4b84-a801-f5af42a9ba14 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "POST /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/action" status: 202 len: 0 microversion: 2.20 time: 0.520159 Aug 29 22:46:40.769151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 205/391] 10.222.0.59 () {62 vars in 1319 bytes} [Mon Aug 29 22:46:40 2022] POST /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:46:40.775483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:40.777427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:40.785022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:40.785946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:40.787082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:40.788711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:40.789475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:40.790927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:40.953471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:40.969110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-54fa3e6a-f0d1-47df-8095-41e41fef3e57 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.243871 Aug 29 22:46:40.970445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 187/392] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:40 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:41.014760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:41.027198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:41.028771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:41.030048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fccbf7de-2973-4102-9816-113d0bb01872 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1751 microversion: 2.20 time: 0.259404 Aug 29 22:46:41.030707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 206/393] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1751 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:41.990475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:41.991088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:41.998688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:41.999175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:41.999608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:42.000411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:42.000868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:42.001544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:42.054980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:42.055623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:42.061713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:42.062204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:42.062673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:42.065175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:42.065175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:42.065175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:42.146989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:42.156042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fc1f048b-e218-44b1-8075-afb6a8e9a93a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.169240 Aug 29 22:46:42.156698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 188/394] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:41 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:42.207492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:42.217900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:42.219289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:42.220641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-48064b79-4f47-40bc-9335-57c0ad39844b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1751 microversion: 2.20 time: 0.169506 Aug 29 22:46:42.221094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 207/395] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:43.178854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:43.179456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:43.189140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:43.189729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:43.190164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:43.191001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:43.191547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:43.191858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:43.244727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:43.245480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:43.251603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:43.252189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:43.252688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:43.253467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:43.253985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:43.254468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:43.350913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:43.359757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-346bd29a-4aa3-49f2-bf80-d93c4e9f3868 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.185672 Aug 29 22:46:43.360388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 189/396] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:43 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:43.403163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:43.413231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:43.414871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:43.416073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-21d3ea5b-b746-4b05-848f-d86083cc1a86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1753 microversion: 2.20 time: 0.175226 Aug 29 22:46:43.416659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 208/397] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:44.381279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:44.381795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:44.389653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:44.390246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:44.390595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:44.391288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:44.391737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:44.392181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:44.446987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:44.448507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:44.454884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:44.455303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:44.455982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:44.456797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:44.457267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:44.457684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:44.538701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:44.550899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-da7fdfd4-62c3-4688-9ec5-d35bd6261296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.170598 Aug 29 22:46:44.550899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 190/398] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:44 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:44.608002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:44.609857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:44.611338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:44.612486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1891edee-c6cd-428d-8f4d-28f4d7b8c56f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1753 microversion: 2.20 time: 0.170017 Aug 29 22:46:44.613054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 209/399] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:45.569121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:45.569724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:45.576579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:45.578881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:45.578881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:45.578881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:45.578881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:45.579240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:45.635653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:45.636302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:45.642728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:45.643217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:45.643653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:45.644394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:45.644879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:45.647646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:45.764656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:45.772935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e9c719ac-f649-4f66-86a9-803a317c930c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.207658 Aug 29 22:46:45.773615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 191/400] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:45 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:45.792656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:45.802588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:45.804083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:45.805875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c85bfc72-c882-47de-b378-5140867a5127 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1753 microversion: 2.20 time: 0.174368 Aug 29 22:46:45.806444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 210/401] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:46.353695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-f26df8f0-ac7f-427f-b2ff-69ec395c086b req-937f19bb-b822-4305-af33-4d2860274520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b697cf12-f552-4b39-89fe-062c61614073", "name": "network-vif-plugged", "status": "completed", "tag": "ade16d2d-3668-4793-a70a-d4f465108efa"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:46.364842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-f26df8f0-ac7f-427f-b2ff-69ec395c086b req-937f19bb-b822-4305-af33-4d2860274520 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:46.365319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-f26df8f0-ac7f-427f-b2ff-69ec395c086b req-937f19bb-b822-4305-af33-4d2860274520 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:46.365833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-f26df8f0-ac7f-427f-b2ff-69ec395c086b req-937f19bb-b822-4305-af33-4d2860274520 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:46.377197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-f26df8f0-ac7f-427f-b2ff-69ec395c086b req-937f19bb-b822-4305-af33-4d2860274520 service nova] Creating event network-vif-plugged:ade16d2d-3668-4793-a70a-d4f465108efa for instance b697cf12-f552-4b39-89fe-062c61614073 on hv-cinder-85426 Aug 29 22:46:46.382581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-f26df8f0-ac7f-427f-b2ff-69ec395c086b req-937f19bb-b822-4305-af33-4d2860274520 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033223 Aug 29 22:46:46.384728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 192/402] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:46.793950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:46.794552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:46.800842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:46.801331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:46.801761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:46.802482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:46.802997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:46.803350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:46.831245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:46.831928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:46.839080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:46.839553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:46.839975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:46.840735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:46.841213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:46.841646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:46.959602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:46.968218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-879123c7-8679-4249-9b49-6e2b9f91bdc6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.178576 Aug 29 22:46:46.968798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 211/403] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:46 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:46.987810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:46.998100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:46.999545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:47.000739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-83396a88-26b1-4ef5-b709-458b4d07caf8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.174589 Aug 29 22:46:47.006814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 193/404] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:47.990852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:47.991462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:47.998280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:47.998768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:47.999204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:47.999897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:48.000391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:48.000819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:48.024804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:48.025430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:48.032667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:48.033155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:48.033593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:48.034288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:48.034740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:48.035161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:48.178136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:48.188020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:48.190030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:48.190909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d1729163-e116-449a-b635-ebd5b24247be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.170320 Aug 29 22:46:48.191553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 194/405] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:48.224463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:48.232795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-32c70ea3-dd26-4965-b5de-3775d681bf9f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1265 microversion: 2.1 time: 0.245911 Aug 29 22:46:48.233379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 212/406] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:47 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:49.215670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:49.216459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:49.223407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.223901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.224382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:49.225087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.225542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.225970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:49.254785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:49.255515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:49.263532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.263532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.263532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:49.264049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.264049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.264549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:49.410528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:49.421447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:49.424051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:49.425586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:49.426759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e7418dba-663e-4d60-a4df-20e70bed624d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.215871 Aug 29 22:46:49.427348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 195/407] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:49.429909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-188250ec-6670-402d-a081-99f1096090d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1451 microversion: 2.1 time: 0.178995 Aug 29 22:46:49.430533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 213/408] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:49 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:46:49.432645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e853b9bc-0d7a-4ce7-a6f1-9eb9ea3b13e8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "165ea33b-6662-4f66-9975-60c91f848eb2", "device": "/dev/sdb"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:49.438040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e853b9bc-0d7a-4ce7-a6f1-9eb9ea3b13e8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:49.442193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e853b9bc-0d7a-4ce7-a6f1-9eb9ea3b13e8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.442687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e853b9bc-0d7a-4ce7-a6f1-9eb9ea3b13e8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.443123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e853b9bc-0d7a-4ce7-a6f1-9eb9ea3b13e8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:49.443825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e853b9bc-0d7a-4ce7-a6f1-9eb9ea3b13e8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.444319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e853b9bc-0d7a-4ce7-a6f1-9eb9ea3b13e8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.444769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e853b9bc-0d7a-4ce7-a6f1-9eb9ea3b13e8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:49.461211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:49.462739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:49.469724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.470279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.470931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:49.471871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:49.472496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:49.472929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:49.613702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:49.623329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-04712ed5-fff4-4075-8096-d64ec10c6ef9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1451 microversion: 2.1 time: 0.166029 Aug 29 22:46:49.624199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 214/409] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:46:49 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:50.163238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e8187f6c-4532-442d-8b88-0006afa9da26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:50.164004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e8187f6c-4532-442d-8b88-0006afa9da26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:50.171638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8187f6c-4532-442d-8b88-0006afa9da26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:50.172123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8187f6c-4532-442d-8b88-0006afa9da26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:50.172662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8187f6c-4532-442d-8b88-0006afa9da26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:50.179046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8187f6c-4532-442d-8b88-0006afa9da26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:50.179046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8187f6c-4532-442d-8b88-0006afa9da26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:50.179046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8187f6c-4532-442d-8b88-0006afa9da26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:50.219396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e8187f6c-4532-442d-8b88-0006afa9da26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/ips" status: 200 len: 149 microversion: 2.1 time: 0.059999 Aug 29 22:46:50.231073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 215/410] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 22:46:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/ips => generated 149 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:50.385579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e853b9bc-0d7a-4ce7-a6f1-9eb9ea3b13e8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "POST /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.956724 Aug 29 22:46:50.392469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 196/411] 10.222.0.59 () {60 vars in 1323 bytes} [Mon Aug 29 22:46:49 2022] POST /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239/os-volume_attachments => generated 194 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:50.452456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:50.457149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:50.460069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:50.460602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:50.461046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:50.461839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:50.462810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:50.463385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:50.722147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:50.732560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:50.734188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:50.735756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-30cf0a34-b526-4e2d-b155-f11a684e38c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.287909 Aug 29 22:46:50.736445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 216/412] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:51.760782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:51.761487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:51.768710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:51.768998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:51.772770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:51.772770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:51.772770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:51.772770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:51.938092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:51.950213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:51.951946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:51.954000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-88a18110-50b0-4887-9d50-2c9d8553ebb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.198131 Aug 29 22:46:51.954582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 197/413] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:52.336165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5c592a41-9a44-405a-804d-69ab39942eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f953de72-ac45-4cab-aa04-011d126c2934"}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:52.339582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5c592a41-9a44-405a-804d-69ab39942eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:52.347349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c592a41-9a44-405a-804d-69ab39942eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:52.347922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c592a41-9a44-405a-804d-69ab39942eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:52.348537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c592a41-9a44-405a-804d-69ab39942eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:52.349303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c592a41-9a44-405a-804d-69ab39942eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:52.349832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c592a41-9a44-405a-804d-69ab39942eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:52.350266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c592a41-9a44-405a-804d-69ab39942eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:52.455259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:52.509101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-7dc11bf7-42c9-46bc-913e-6dde1e77a092 req-e517d248-3aca-4616-b600-1824f7993799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b697cf12-f552-4b39-89fe-062c61614073", "tag": "ade16d2d-3668-4793-a70a-d4f465108efa"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:46:52.521400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-7dc11bf7-42c9-46bc-913e-6dde1e77a092 req-e517d248-3aca-4616-b600-1824f7993799 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:52.522335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-7dc11bf7-42c9-46bc-913e-6dde1e77a092 req-e517d248-3aca-4616-b600-1824f7993799 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:52.522885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-7dc11bf7-42c9-46bc-913e-6dde1e77a092 req-e517d248-3aca-4616-b600-1824f7993799 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:52.548820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-7dc11bf7-42c9-46bc-913e-6dde1e77a092 req-e517d248-3aca-4616-b600-1824f7993799 service nova] Creating event network-changed:ade16d2d-3668-4793-a70a-d4f465108efa for instance b697cf12-f552-4b39-89fe-062c61614073 on hv-cinder-85426 Aug 29 22:46:52.556862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-7dc11bf7-42c9-46bc-913e-6dde1e77a092 req-e517d248-3aca-4616-b600-1824f7993799 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051471 Aug 29 22:46:52.558636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 198/414] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:52.987449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:52.989989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:53.027367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:53.028298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:53.029078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:53.030341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:53.031160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:53.031920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:53.193783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:53.203958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:53.205487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:53.206925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9d223ce7-7776-48ff-ac2c-d8dcd36686bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.228858 Aug 29 22:46:53.207511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 199/415] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:54.232765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:54.233490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:54.239845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:54.240373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:54.240810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:54.241495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:54.241943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:54.242372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:54.394547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:54.405718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:54.407442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:54.408901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bb077f12-df78-44a5-a088-0c5cc8f9697e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.180259 Aug 29 22:46:54.409985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 200/416] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:55.433722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:55.436490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:55.441024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:55.441499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:55.441929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:55.442617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:55.443061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:55.443481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:55.657712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:55.667860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:55.669391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:55.670509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-063352e3-8da5-4959-86a0-a4ea42e6d1fe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.241707 Aug 29 22:46:55.671070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 201/417] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:55 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:56.695985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:56.696912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:56.704516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:56.705111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:56.706652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:56.707530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:56.708103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:56.708671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:56.852687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:56.861720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:56.863164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:56.864342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aa4e942b-0202-4efc-a562-41ab968078ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.172364 Aug 29 22:46:56.864965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 202/418] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:57.888376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:57.888989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:57.896395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:57.896895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:57.897335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:57.898066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:57.898514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:57.898936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:58.066400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:58.070033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:58.076459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:58.077911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:58.079064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2875d47d-ec6b-435d-b6c6-cdd5c0d21463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.195045 Aug 29 22:46:58.079623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 203/419] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:46:59.103425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:59.104185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:46:59.108873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=68 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:59.113095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:59.113704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:59.114134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:59.114819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:59.115261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:59.115763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:59.274447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:59.283764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:59.285281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:46:59.286466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a7e7fc7d-439a-491f-aa40-f4feef91dded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.187346 Aug 29 22:46:59.287034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 204/420] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:46:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:00.313279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:00.313954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:00.320502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:00.320981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:00.321485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:00.322221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:00.322672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:00.323126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:00.467173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:00.476917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:00.478466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:00.479800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5fd633a7-8ac9-4e6b-bb2c-c5c0436753ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.171129 Aug 29 22:47:00.480502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 205/421] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:01.504420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:01.505115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:01.512197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:01.512680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:01.513112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:01.513795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:01.514244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:01.514764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:01.653725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:01.662726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:01.664182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:01.665319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-60e6bde2-38f0-486e-85f7-ed4b52a317ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.164891 Aug 29 22:47:01.665868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 206/422] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:02.344485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:02.688747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:02.689352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:02.695806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:02.696325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:02.696755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:02.697505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:02.697946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:02.698367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:02.840206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:02.849131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:02.850626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:02.851825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f966b73d-c864-42b8-b7b1-06ff2ea2370e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.166992 Aug 29 22:47:02.852418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 207/423] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:03.875106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:03.875741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:03.882128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:03.882604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:03.883033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:03.883706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:03.884176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:03.884599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:04.017452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:04.026056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:04.027520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:04.029463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b2dde3a9-53e8-4f8f-855b-37c336623963 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.157749 Aug 29 22:47:04.029463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 208/424] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:04.871253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5c592a41-9a44-405a-804d-69ab39942eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.539634 Aug 29 22:47:04.883953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 217/425] 10.222.0.59 () {60 vars in 1323 bytes} [Mon Aug 29 22:46:52 2022] POST /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 194 bytes in 12542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:05.052010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:05.052740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:05.059384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:05.059970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:05.060421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:05.061135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:05.061589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:05.062000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:05.229216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:05.238208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:05.239666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:05.240894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-94145017-f790-46f6-9ae5-0847c8551974 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.193049 Aug 29 22:47:05.241453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 209/426] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:06.264290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:06.265085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:06.272261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:06.272831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:06.273346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:06.274050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:06.274506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:06.274937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:06.414213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:06.425308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:06.426787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:06.428386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6eb2b4d2-f8c5-4eca-9897-36bdfe2469b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.168092 Aug 29 22:47:06.429230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 218/427] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:07.460700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:07.461366 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:07.468306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.468805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.469239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.469935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:07.470429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:07.470878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:07.608828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:07.617659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:07.619121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:07.620410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e22bf7f0-6a87-4c68-9dbf-d687e09f76b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.164284 Aug 29 22:47:07.620975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 210/428] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:08.644316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:08.644922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:08.651380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.651864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.652329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.653017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:08.653467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:08.653897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:08.789723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:08.798594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:08.799964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:08.801146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6ae259b3-0d44-4b4b-8487-b0ead568e525 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.161319 Aug 29 22:47:08.801697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 219/429] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:09.824942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:09.825542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:09.833000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:09.833482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:09.833912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:09.834602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:09.835049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:09.835467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:09.975922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:09.985747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:09.987184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:09.988378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-282a91af-e28e-4931-b1f4-263701c2ac4c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.167315 Aug 29 22:47:09.989005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 211/430] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:11.011134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:11.011741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:11.018547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:11.019102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:11.020087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:11.021043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:11.021491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:11.021906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:11.156604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:11.165894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:11.167465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:11.168654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5cf5c0fb-4e4a-46ba-841a-6a25340d680a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.161562 Aug 29 22:47:11.169216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 220/431] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:12.191553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:12.193558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:12.201370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:12.201994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:12.202446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:12.203174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:12.203625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:12.204760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:12.353380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:12.362633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:12.364100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:12.365775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-175262da-b640-4c41-8a83-12cefbaf011c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.178445 Aug 29 22:47:12.366551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 212/432] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:13.390875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:13.395248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:13.398657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:13.399134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:13.399558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:13.400414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:13.400902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:13.401319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:13.545832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:13.555855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:13.557320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:13.558457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1ce11a45-28d6-4e1b-abb2-883bd10c2086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.171664 Aug 29 22:47:13.559009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 221/433] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:14.582562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:14.583204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:14.590723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:14.591198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:14.591624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:14.592345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:14.592795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:14.593233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:14.727127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:14.735841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:14.737379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:14.738512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c2fbf6dd-d369-4734-af5d-3d83c81df046 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.160249 Aug 29 22:47:14.739053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 213/434] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:15.762436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:15.763026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:15.770253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.770733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.771722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.772483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.773000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.773434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.865563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-0df7e432-ab88-49e5-8e10-acdf412a5c49 req-fd786e3f-ca5b-492d-ab61-6cab1fc3c2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e568957-b28a-4d75-b458-3f8e95bb38d0", "name": "network-vif-plugged", "status": "completed", "tag": "2eaca61c-9e3d-41ec-b39b-74fe4d54599d"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:15.875267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-0df7e432-ab88-49e5-8e10-acdf412a5c49 req-fd786e3f-ca5b-492d-ab61-6cab1fc3c2e5 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:15.875745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-0df7e432-ab88-49e5-8e10-acdf412a5c49 req-fd786e3f-ca5b-492d-ab61-6cab1fc3c2e5 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:15.876182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-0df7e432-ab88-49e5-8e10-acdf412a5c49 req-fd786e3f-ca5b-492d-ab61-6cab1fc3c2e5 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:15.888500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-0df7e432-ab88-49e5-8e10-acdf412a5c49 req-fd786e3f-ca5b-492d-ab61-6cab1fc3c2e5 service nova] Creating event network-vif-plugged:2eaca61c-9e3d-41ec-b39b-74fe4d54599d for instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 on hv-cinder-85426 Aug 29 22:47:15.893741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-0df7e432-ab88-49e5-8e10-acdf412a5c49 req-fd786e3f-ca5b-492d-ab61-6cab1fc3c2e5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032586 Aug 29 22:47:15.894334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 214/435] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:15.918482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:15.927894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:15.929576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:15.930831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5b174851-f056-4ab2-9e61-d39826860c81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.172312 Aug 29 22:47:15.931397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 222/436] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:16.956285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:16.957001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:16.963681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.964188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.964622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:16.965306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:16.965803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:16.966231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:17.102357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:17.111671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:17.114415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:17.114729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2cc32fc7-5a16-480b-9347-93c96f133eb1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.163452 Aug 29 22:47:17.115844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 215/437] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:18.139197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:18.139826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:18.147160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:18.147646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:18.148123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:18.148967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:18.149458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:18.149963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:18.285942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:18.294970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:18.298599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:18.298599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ecf0c991-1ccc-49eb-8b91-e291224b9b74 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.162708 Aug 29 22:47:18.298599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 223/438] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:19.321433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:19.322076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:19.328916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.329401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.329954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.330652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:19.331354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:19.331778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:19.467010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:19.476760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:19.478268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:19.479439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8fa9e724-b471-4ca8-bc87-214661b9ed9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.162294 Aug 29 22:47:19.480002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 216/439] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:20.502862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:20.503463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:20.510543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.511032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.511469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.512187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:20.512642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:20.513068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:20.649480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:20.658256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:20.659705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:20.660885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dc18dbae-a68b-4f6d-ac3f-8e39d3514eb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.161999 Aug 29 22:47:20.661441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 224/440] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:21.684806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:21.685412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:21.692476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:21.692969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:21.694149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:21.694843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:21.695288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:21.695739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:21.828691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:21.837745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:21.839263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:21.840447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e6c49a6f-6282-41eb-b9ab-d3e3877b61d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.159552 Aug 29 22:47:21.841011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 217/441] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:22.865507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:22.866180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:22.873881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.874466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.874958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:22.875856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:22.876335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:22.881458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:23.014015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:23.023028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:23.024644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:23.025820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-87a46639-5d54-4bec-9bd2-8e5b99e058e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.165151 Aug 29 22:47:23.026402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 225/442] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:24.048670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:24.049466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:24.058191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:24.058670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:24.059099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:24.059834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:24.060343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:24.060762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:24.212255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:24.221276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:24.222711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:24.223853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-76b479f2-de34-4e16-827e-01a64b1ce02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.179611 Aug 29 22:47:24.224438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 218/443] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:25.248325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:25.248864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:25.255455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:25.255940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:25.256418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:25.257108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:25.257564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:25.257991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:25.392655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:25.402597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:25.404207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:25.405379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8cfed547-2ded-49d7-9a00-5f702c364c34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.161135 Aug 29 22:47:25.405955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 226/444] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:26.429182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:26.429878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:26.437628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:26.438108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:26.438587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:26.439290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:26.439741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:26.440182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:26.574300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:26.583262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:26.587788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:26.587788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-880fb148-55c9-411c-a671-900c8dac7b93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1809 microversion: 2.20 time: 0.160901 Aug 29 22:47:26.587788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 219/445] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:27.278168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7ed59dcb-bf66-4c3a-8814-85d0b4a981ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: .version_select at 0x7febd522bf70>, body: {"keypair": {"name": "tempest-keypair-1725617119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwo1DlQQrRyjAYj2TcqBU3CaJABjk/BjxakEHPIPiURXi3RGQFjHKUjthZXqncScJohIRnSQpbFRpKMTvIMp8gQ3DUWkknZFpW43/aBfDV0i53T4ckZM7f1wM3jL3LDpQ=="}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:27.294655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-7ed59dcb-bf66-4c3a-8814-85d0b4a981ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for project a826c462a3fa429eb866d354afcbe950. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:47:27.299220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-7ed59dcb-bf66-4c3a-8814-85d0b4a981ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for user 9c2fdfdb62b54f05b7d81f14ec197cca and project a826c462a3fa429eb866d354afcbe950. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:47:27.433093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7ed59dcb-bf66-4c3a-8814-85d0b4a981ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159037 Aug 29 22:47:27.434105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 227/446] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 22:47:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:27.611588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:27.612241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:27.618626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:27.619208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:27.619643 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:27.620368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:27.620828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:27.621244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:27.759130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:27.767839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:27.769329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:27.770486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1bceaae1-933e-440c-8f42-21919706c953 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1796 microversion: 2.20 time: 0.162951 Aug 29 22:47:27.771047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 220/447] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 22:47:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1796 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:47:29.960157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1268920305", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02e67e56-1d54-4626-ac0f-73743cdc8b11"}], "security_groups": [{"name": "tempest-securitygroup--1046552457"}], "key_name": "tempest-keypair-1725617119", "user_data": "}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:30.069364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] validate_networks() for [('02e67e56-1d54-4626-ac0f-73743cdc8b11', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:47:30.298828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:30.299385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:30.301931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=34 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:30.306652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.318547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.318547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.318547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.318547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.318909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.340626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:30.442682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lazy-loading 'services' on Instance uuid ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:30.462587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:47:30.463124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:47:30.463581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:47:30.463991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:47:30.464591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:47:30.474217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.474698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.475140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.475868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:30.476377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:30.476828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:30.493821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for project a826c462a3fa429eb866d354afcbe950. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:47:30.498014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for user 9c2fdfdb62b54f05b7d81f14ec197cca and project a826c462a3fa429eb866d354afcbe950. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:47:30.509834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:47:30.512917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:47:30.727283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d873fc5b-452f-4267-a708-980f454521b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.772105 Aug 29 22:47:30.728882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 228/448] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:47:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:47:30.739907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a869e299-6ad6-4d7c-9a8c-35f9e2685846 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:30.740564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a869e299-6ad6-4d7c-9a8c-35f9e2685846 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:30.798921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e936b0af-de71-4d1f-a9c6-fffa7d376101 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239/os-volume_attachments/165ea33b-6662-4f66-9975-60c91f848eb2" status: 202 len: 0 microversion: 2.1 time: 0.504331 Aug 29 22:47:30.799378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a869e299-6ad6-4d7c-9a8c-35f9e2685846 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:30.802953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 221/449] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:47:30 2022] DELETE /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239/os-volume_attachments/165ea33b-6662-4f66-9975-60c91f848eb2 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:30.809539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a869e299-6ad6-4d7c-9a8c-35f9e2685846 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1242 microversion: 2.1 time: 0.073410 Aug 29 22:47:30.810775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 229/450] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:30 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:31.832883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:31.833585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:31.840498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.842835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.842835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.842835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:31.842835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:31.843192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:31.911520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:31.929730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8c023566-b212-4156-b16c-35b3e2bf6dbc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1246 microversion: 2.1 time: 0.093688 Aug 29 22:47:31.929730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 222/451] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:31 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:32.941645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:32.942251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:32.944717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:32.950219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.950749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.951280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.951979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.952464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.952874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.994072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:32.995221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:33.002045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:33.002645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:33.003115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:33.003812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:33.004299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:33.004727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:33.023813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:33.031561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4a94ae3c-1ebe-418d-a113-134d81a4a7a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1294 microversion: 2.1 time: 0.093580 Aug 29 22:47:33.032158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 230/452] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:32 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:33.034533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:47:33.461602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7cd6f27b-a372-4909-bd3f-2ff21e6e01a2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 204 len: 0 microversion: 2.1 time: 0.471469 Aug 29 22:47:33.462246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 223/453] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 22:47:32 2022] DELETE /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:47:33.471634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:33.472293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:33.478374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:33.478851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:33.479274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:33.479955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:33.480432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:33.480860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:33.616754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:33.624671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c6db6af7-93c7-4dd6-9e61-975654a39bcc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1512 microversion: 2.1 time: 0.157471 Aug 29 22:47:33.625229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 231/454] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:33 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:34.053165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:34.053859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:34.061021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:34.061501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:34.061927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.062612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:34.063079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:34.063496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.126686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:34.134368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-737a97d9-9fe6-4387-9aae-db1ec7a28fdf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1302 microversion: 2.1 time: 0.085471 Aug 29 22:47:34.134927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 224/455] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:34 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:34.644849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:34.645492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:34.653231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:34.653739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:34.654168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.654864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:34.655448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:34.655794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:34.658667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:34.793094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:34.801368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2114627a-1a6a-4d72-b5df-9d0b0e81b351 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1512 microversion: 2.1 time: 0.160349 Aug 29 22:47:34.802067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 232/456] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:34 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:35.155620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:35.156265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:35.163042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:35.163524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:35.163961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:35.164698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:35.165172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:35.165623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:35.232702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:35.240673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1cdeebf1-4e77-4507-8dc7-6261616f776b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1302 microversion: 2.1 time: 0.089261 Aug 29 22:47:35.241250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 225/457] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:35 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:35.823545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:35.824543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:35.831922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:35.832451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:35.832887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:35.833583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:35.834038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:35.834477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:36.019749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:36.028450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1615327d-608e-4827-ba06-9bffe1dedb68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1512 microversion: 2.1 time: 0.208756 Aug 29 22:47:36.043272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 233/458] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:35 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:36.261885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:36.262514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:36.269794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:36.270290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:36.270700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:36.271384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:36.271836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:36.272301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:36.335882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:36.345532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d98cdc1c-1e00-4ccf-8e85-e69a0ff78548 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1300 microversion: 2.1 time: 0.087865 Aug 29 22:47:36.346319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 226/459] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:36 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:36.420807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-9aa94492-c9ba-46f4-b413-832ab2af61b9 req-e3b079b7-2d50-469b-9962-b1b3a47d9ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239", "name": "network-vif-deleted", "tag": "f3dd0985-27c8-45ca-b9b5-2517ef13ed73"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:36.430554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9aa94492-c9ba-46f4-b413-832ab2af61b9 req-e3b079b7-2d50-469b-9962-b1b3a47d9ec9 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:36.431349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9aa94492-c9ba-46f4-b413-832ab2af61b9 req-e3b079b7-2d50-469b-9962-b1b3a47d9ec9 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:36.431770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9aa94492-c9ba-46f4-b413-832ab2af61b9 req-e3b079b7-2d50-469b-9962-b1b3a47d9ec9 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:36.443772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-9aa94492-c9ba-46f4-b413-832ab2af61b9 req-e3b079b7-2d50-469b-9962-b1b3a47d9ec9 service nova] Creating event network-vif-deleted:f3dd0985-27c8-45ca-b9b5-2517ef13ed73 for instance ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 on hv-cinder-85426 Aug 29 22:47:36.449241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-9aa94492-c9ba-46f4-b413-832ab2af61b9 req-e3b079b7-2d50-469b-9962-b1b3a47d9ec9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032835 Aug 29 22:47:36.450247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 234/460] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:37.049992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:37.050602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:37.056667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.057152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.057585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.058339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.058847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.059247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.095674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.096184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.096617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.097072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lazy-loading 'fault' on Instance uuid ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:37.180455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:37.189117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-645e58ae-3e8e-456f-b9b2-ebd7f0e14e18 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 200 len: 1307 microversion: 2.1 time: 0.142786 Aug 29 22:47:37.189793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 227/461] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:37 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 1307 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:37.367942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:37.368670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:37.376412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.376915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.377362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.378063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.378520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.379019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.399731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-f6ac5b26-a3ea-4350-ba53-ccac4795d916 req-4e8f22c9-0f90-4323-837c-36a6c7f196a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f93cf86-a1d6-46b8-8b19-07daf0b193ff", "tag": "760fa8c7-78ec-4520-a365-80d33ec202a6"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:37.410205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-f6ac5b26-a3ea-4350-ba53-ccac4795d916 req-4e8f22c9-0f90-4323-837c-36a6c7f196a4 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:37.410748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-f6ac5b26-a3ea-4350-ba53-ccac4795d916 req-4e8f22c9-0f90-4323-837c-36a6c7f196a4 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:37.411239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-f6ac5b26-a3ea-4350-ba53-ccac4795d916 req-4e8f22c9-0f90-4323-837c-36a6c7f196a4 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:37.425231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-f6ac5b26-a3ea-4350-ba53-ccac4795d916 req-4e8f22c9-0f90-4323-837c-36a6c7f196a4 service nova] Creating event network-changed:760fa8c7-78ec-4520-a365-80d33ec202a6 for instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff on hv-cinder-85426 Aug 29 22:47:37.430225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-f6ac5b26-a3ea-4350-ba53-ccac4795d916 req-4e8f22c9-0f90-4323-837c-36a6c7f196a4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034137 Aug 29 22:47:37.430907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 228/462] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:37.531640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:37.539579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0871b6b6-172b-4956-a036-7d0f4febb661 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.176533 Aug 29 22:47:37.540363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 235/463] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:37 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:38.211567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:38.212289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:38.220278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.220755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.221188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.221870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.222315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.222726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.236368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] HTTP exception thrown: Instance ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 could not be found. Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Request method failure captured: Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 HTTP/1.1 Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUGucquLiToEd8Q-5eJyuXwvCos8kRq5YEubkON8o9nDDaSeMjb6EzGTPGcjqKJUrgoPFG-4TXP3xbcX-YDOmH0ya0FFzFPY-fY6v270tmjKTDaYLWomoQ8c1RET9cn-IrMibGbdWZvXJIM0GhBSkS3T8f3nROkkNVfyzuPyESAHUdk Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 22:47:38.238072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2c0dcefe769247eaa49da038e336bc8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 484c09f238bd4b0d91b6aeaee913f7d5 Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 could not be found. Aug 29 22:47:38.239656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': 'ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239'} Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 could not be found. Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:47:38.240594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 could not be found. Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 could not be found. Aug 29 22:47:38.241870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:47:38.243200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Returning 404 to user: Instance ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:47:38.243200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5811443c-62f4-47d8-932a-d476d552eaab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239" status: 404 len: 111 microversion: 2.1 time: 0.032082 Aug 29 22:47:38.243200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 229/464] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:38 2022] GET /compute/v2.1/servers/ab43ed6d-1cf2-41bf-b1cd-3b8b06f39239 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:47:38.561409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:38.562006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:38.568858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.569335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.569751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.570481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:38.570892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:38.571305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:38.705672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:38.714655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8724ee22-f9e4-4af4-8c14-b6f963cb6692 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.157244 Aug 29 22:47:38.715243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 236/465] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:38 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:39.737536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:39.738526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:39.745270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:39.745754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:39.746245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:39.746940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:39.747388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:39.747814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:39.879381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:39.888038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a655fe2c-e229-4cea-9ba0-3adc7e9050b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.154223 Aug 29 22:47:39.889139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 230/466] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:39 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:40.909306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:40.909909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:40.912378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:40.913529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=12 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:40.918681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:40.919168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:40.919600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:40.920388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:40.920844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:40.921265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:41.058478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:41.067292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9e06a381-3bdc-4d66-a116-84be4022e88c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.161910 Aug 29 22:47:41.067881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 237/467] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:40 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:42.088366 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:42.088943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:42.096384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:42.096862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:42.097342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:42.098016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:42.098497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:42.098918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:42.233826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:42.241580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1017fe5b-e365-437c-8b00-1acd404503bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.157125 Aug 29 22:47:42.242174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 231/468] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:42 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:42.509643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:42.510163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:42.517791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:42.518276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:42.521245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:42.521245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:42.521245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:42.521245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:42.652992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lazy-loading 'services' on Instance uuid b82aaeac-b1e6-4be1-a5a5-0605c648b05c {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:42.965100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7d307818-f5e8-41e2-a2b0-f2379d6a6f4c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/os-volume_attachments/f8ce7311-ed29-4eed-99cb-3d756a0af62a" status: 202 len: 0 microversion: 2.1 time: 0.459529 Aug 29 22:47:42.965702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 238/469] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:47:42 2022] DELETE /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/os-volume_attachments/f8ce7311-ed29-4eed-99cb-3d756a0af62a => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:43.262886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:43.263539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:43.270240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:43.272506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:43.272506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:43.272506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:43.272506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:43.272900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:43.404194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:43.412577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9ceabeed-26ac-42fd-b5bf-e518c231cf10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.153639 Aug 29 22:47:43.413142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 232/470] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:43 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:44.134579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-3402c231-39f0-4dcf-9a08-a08295cdaedf req-f5fef85e-b28b-48ef-b3e5-7b6ba7842814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f93cf86-a1d6-46b8-8b19-07daf0b193ff", "name": "network-vif-plugged", "status": "completed", "tag": "760fa8c7-78ec-4520-a365-80d33ec202a6"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:44.145134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-3402c231-39f0-4dcf-9a08-a08295cdaedf req-f5fef85e-b28b-48ef-b3e5-7b6ba7842814 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:44.145603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-3402c231-39f0-4dcf-9a08-a08295cdaedf req-f5fef85e-b28b-48ef-b3e5-7b6ba7842814 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:44.146020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-3402c231-39f0-4dcf-9a08-a08295cdaedf req-f5fef85e-b28b-48ef-b3e5-7b6ba7842814 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:44.157614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-3402c231-39f0-4dcf-9a08-a08295cdaedf req-f5fef85e-b28b-48ef-b3e5-7b6ba7842814 service nova] Creating event network-vif-plugged:760fa8c7-78ec-4520-a365-80d33ec202a6 for instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff on hv-cinder-85426 Aug 29 22:47:44.162212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-3402c231-39f0-4dcf-9a08-a08295cdaedf req-f5fef85e-b28b-48ef-b3e5-7b6ba7842814 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Aug 29 22:47:44.162796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 239/471] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:44.433286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:44.433940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:44.442323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:44.442746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:44.443232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:44.443906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:44.444396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:44.444820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:44.615356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:44.623844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5396479a-7830-4e68-ac32-bbf609834575 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.194202 Aug 29 22:47:44.624548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 233/472] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:44 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:45.158254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bae589f7-f842-4414-b1f9-f43efc1fb042 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:45.168046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bae589f7-f842-4414-b1f9-f43efc1fb042 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:45.168875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bae589f7-f842-4414-b1f9-f43efc1fb042 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:45.169594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bae589f7-f842-4414-b1f9-f43efc1fb042 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:45.203318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bae589f7-f842-4414-b1f9-f43efc1fb042 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Going to try to stop instance {{(pid=128150) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 22:47:45.449063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bae589f7-f842-4414-b1f9-f43efc1fb042 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/action" status: 202 len: 0 microversion: 2.1 time: 0.296425 Aug 29 22:47:45.449689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 240/473] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:47:45 2022] POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:47:45.459590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:45.460230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:45.468824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:45.469310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:45.469748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:45.470439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:45.470895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:45.471313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:45.622876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:45.631021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1ed048cb-10c6-4e3f-b2fe-ad2986af35e9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.176094 Aug 29 22:47:45.631595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 234/474] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:45 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:45.646404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:45.647098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:45.653589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:45.654078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:45.654534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:45.658901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:45.658901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:45.658901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:45.790355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:45.798957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d40dbea7-54a4-4d32-860b-9212cf187ec2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.156836 Aug 29 22:47:45.799549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 241/475] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:45 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:46.659630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:46.660309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:46.667223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:46.667732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:46.668186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:46.668865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:46.669337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:46.669755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:46.803409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:46.812306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-38777ec5-cdb2-416a-8b89-ea2bc4a58670 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.157344 Aug 29 22:47:46.812926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 235/476] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:46 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:46.820809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:46.821504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:46.828405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:46.828882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:46.829307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:46.829986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:46.830438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:46.830854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:46.968992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:46.976660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-90c96012-3b57-45b9-b759-c22eced3a799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.159758 Aug 29 22:47:46.977251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 242/477] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:46 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:47.833980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:47.834593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:47.841383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:47.841808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:47.842856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:47.843422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:47.843876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:47.844332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:47.863378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:47.978877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:47.986715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-284793fa-0e62-4fa3-a7a0-52d4d450a96e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.156895 Aug 29 22:47:47.987284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 236/478] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:47 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:47.998757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:48.000034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:48.006845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:48.007323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:48.007749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:48.008467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:48.008914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:48.009328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:48.145850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:48.153690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0b1670b7-ae04-4d5d-9e20-956940d369c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1368 microversion: 2.1 time: 0.158803 Aug 29 22:47:48.154259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 243/479] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:47 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:48.886758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7db208a5-28fa-4d3f-a114-625f72a80de1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab742603-e3e4-4f53-a40e-07794971b6aa"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:48.889336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7db208a5-28fa-4d3f-a114-625f72a80de1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:48.902902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-774523009", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "networks": [{"uuid": "bf386cf4-b44b-4dfd-9345-388c689ec005"}]}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:48.903089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7db208a5-28fa-4d3f-a114-625f72a80de1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:48.903089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7db208a5-28fa-4d3f-a114-625f72a80de1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:48.903089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7db208a5-28fa-4d3f-a114-625f72a80de1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:48.903089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7db208a5-28fa-4d3f-a114-625f72a80de1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:48.903391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7db208a5-28fa-4d3f-a114-625f72a80de1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:48.903391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7db208a5-28fa-4d3f-a114-625f72a80de1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:48.960997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] validate_networks() for [('bf386cf4-b44b-4dfd-9345-388c689ec005', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:47:49.345965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:47:49.346571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:47:49.346958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:47:49.347308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:47:49.347718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:47:49.357744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:49.358806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:49.359232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:49.360059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:49.360539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:49.360995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:49.378702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Getting quotas for project 2c0dcefe769247eaa49da038e336bc8a. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:47:49.382693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Getting quotas for user 484c09f238bd4b0d91b6aeaee913f7d5 and project 2c0dcefe769247eaa49da038e336bc8a. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:47:49.395087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:47:49.397428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:47:49.549598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-38281483-9c4c-4f54-b923-cbd0a23e6025 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663008 Aug 29 22:47:49.550436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 244/480] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:47:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:47:49.554861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:49.555467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:49.561891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:49.562413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:49.562877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:49.563550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:49.564005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:49.564462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:49.723842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:49.731916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3fffe0fa-36bd-4204-8806-bea47e83c50c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.180550 Aug 29 22:47:49.732520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 245/481] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:49 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:49.737514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:49.738324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:49.744748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:49.745245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:49.745678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:49.746373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:49.746822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:49.747240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:49.902640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:49.911818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8b4b52e8-a033-4338-a2a5-91fe4586fefa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1558 microversion: 2.1 time: 0.178053 Aug 29 22:47:49.924248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 246/482] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:49 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:49.929214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-039f44bc-b966-47f2-b5b5-db1fb8e7eed6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:49.934861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-039f44bc-b966-47f2-b5b5-db1fb8e7eed6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:49.984796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-039f44bc-b966-47f2-b5b5-db1fb8e7eed6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:49.992327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-039f44bc-b966-47f2-b5b5-db1fb8e7eed6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1218 microversion: 2.1 time: 0.078219 Aug 29 22:47:49.992910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 247/483] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:49 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:49.997702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9ef4f668-6fa5-4b56-86e7-10b4f51583ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:49.998298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9ef4f668-6fa5-4b56-86e7-10b4f51583ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:50.005263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef4f668-6fa5-4b56-86e7-10b4f51583ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:50.005750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef4f668-6fa5-4b56-86e7-10b4f51583ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:50.006186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef4f668-6fa5-4b56-86e7-10b4f51583ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:50.006880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef4f668-6fa5-4b56-86e7-10b4f51583ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:50.007465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef4f668-6fa5-4b56-86e7-10b4f51583ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:50.007828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef4f668-6fa5-4b56-86e7-10b4f51583ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:50.094336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9ef4f668-6fa5-4b56-86e7-10b4f51583ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100358 Aug 29 22:47:50.095132 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 248/484] 10.222.0.59 () {58 vars in 1275 bytes} [Mon Aug 29 22:47:49 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:50.754769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:50.755423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:50.761323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:50.761807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:50.762245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:50.762939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:50.763387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:50.763814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:50.806627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7db208a5-28fa-4d3f-a114-625f72a80de1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.925040 Aug 29 22:47:50.807319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 237/485] 10.222.0.59 () {60 vars in 1323 bytes} [Mon Aug 29 22:47:48 2022] POST /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 194 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:50.948025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:50.957691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c37783dc-d7fe-4561-8e73-ef23da050d4b tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.207479 Aug 29 22:47:50.958284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 249/486] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:50 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:51.017856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:51.017856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:51.024233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:51.025069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:51.025815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:51.026719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:51.027251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:51.027595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:51.364645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:51.373339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-63126051-aec4-4f89-94ef-ed06b235b96c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1222 microversion: 2.1 time: 0.362537 Aug 29 22:47:51.375007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 238/487] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:51 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1222 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:51.574034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-1bee4338-da06-4cc7-a229-74af644b7769 req-a226e1b3-6575-4e3e-9f5e-e5e8a0331493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f93cf86-a1d6-46b8-8b19-07daf0b193ff", "tag": "760fa8c7-78ec-4520-a365-80d33ec202a6"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:51.586123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-1bee4338-da06-4cc7-a229-74af644b7769 req-a226e1b3-6575-4e3e-9f5e-e5e8a0331493 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:51.586733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-1bee4338-da06-4cc7-a229-74af644b7769 req-a226e1b3-6575-4e3e-9f5e-e5e8a0331493 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:51.587226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-1bee4338-da06-4cc7-a229-74af644b7769 req-a226e1b3-6575-4e3e-9f5e-e5e8a0331493 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:51.601048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-1bee4338-da06-4cc7-a229-74af644b7769 req-a226e1b3-6575-4e3e-9f5e-e5e8a0331493 service nova] Creating event network-changed:760fa8c7-78ec-4520-a365-80d33ec202a6 for instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff on hv-cinder-85426 Aug 29 22:47:51.606915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-1bee4338-da06-4cc7-a229-74af644b7769 req-a226e1b3-6575-4e3e-9f5e-e5e8a0331493 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036505 Aug 29 22:47:51.609002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 250/488] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:47:51.986663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:51.987277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:51.993491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:51.994044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:51.994575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:51.995284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:51.995737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:51.996339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:52.131381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:52.139521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-64c4ecf6-a2e9-4e9f-acbf-1b7da671e60a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.157397 Aug 29 22:47:52.140230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 239/489] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:51 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:52.397285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:52.398660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:52.405729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:52.406358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:52.407082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:52.407484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:52.407996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:52.408640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:52.413412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:52.495400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:52.506102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7c508b1e-5180-4d62-b4fe-3c09e3ee44e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1278 microversion: 2.1 time: 0.113208 Aug 29 22:47:52.508173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 251/490] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:52 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:53.162680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:53.163490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:53.173870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:53.174299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:53.174739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:53.175474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:53.175922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:53.176373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:53.318625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:53.330227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c50694bb-32a0-49de-8da6-d58d334e8cc8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.171750 Aug 29 22:47:53.331322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 240/491] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:53 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:53.531225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:53.531984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:53.539495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:53.540449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:53.540449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:53.541146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:53.541608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:53.542029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:54.019438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:54.027793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a109f375-689c-46ef-975a-dec60f98cb6c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.502022 Aug 29 22:47:54.028552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 252/492] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:53 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:54.356068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:54.356068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:54.362575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:54.363076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:54.363677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:54.364598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:54.365028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:54.365784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:54.498320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:54.506623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f5e7c3a0-f380-4389-86ec-859657a1b7ac tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.155679 Aug 29 22:47:54.507191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 241/493] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:54 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:54.616895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-e0d4ca52-9106-4388-9a66-56bb70d5f1a5 req-7c7e58dc-22fa-4200-ab7b-b7a32ed13acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ddee20-0f21-4105-80d6-d388c1146f7d", "tag": "0e534abd-48b9-4065-800c-833daa6bb98c"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:54.628231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-e0d4ca52-9106-4388-9a66-56bb70d5f1a5 req-7c7e58dc-22fa-4200-ab7b-b7a32ed13acb service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:54.635340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-e0d4ca52-9106-4388-9a66-56bb70d5f1a5 req-7c7e58dc-22fa-4200-ab7b-b7a32ed13acb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:54.635340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-e0d4ca52-9106-4388-9a66-56bb70d5f1a5 req-7c7e58dc-22fa-4200-ab7b-b7a32ed13acb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:54.641304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-e0d4ca52-9106-4388-9a66-56bb70d5f1a5 req-7c7e58dc-22fa-4200-ab7b-b7a32ed13acb service nova] Creating event network-changed:0e534abd-48b9-4065-800c-833daa6bb98c for instance 97ddee20-0f21-4105-80d6-d388c1146f7d on hv-cinder-85426 Aug 29 22:47:54.646207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-e0d4ca52-9106-4388-9a66-56bb70d5f1a5 req-7c7e58dc-22fa-4200-ab7b-b7a32ed13acb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033297 Aug 29 22:47:54.647005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 253/494] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:47:55.050425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:55.051066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:55.057199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:55.057686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:55.058117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:55.058806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:55.059257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:55.059674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:55.204664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:55.213329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3fa3fc47-08b1-48f1-800e-5696f32bd3a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.167471 Aug 29 22:47:55.214090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 242/495] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:55 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:55.528997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:55.529754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:55.536055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:55.537214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:55.537648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:55.538336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:55.538782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:55.539197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:55.675697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:55.683564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3c62e714-6ea7-42aa-b180-223ecee688e3 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.158911 Aug 29 22:47:55.684128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 254/496] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:55 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:56.233518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:56.234163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:56.240801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:56.241278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:56.241728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:56.242395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:56.242845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:56.243262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:56.375797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:56.383665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-50da4eb7-1ea6-4c5e-90d4-ea01e93e591a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.154228 Aug 29 22:47:56.384262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 243/497] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:56 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:56.705484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:56.706328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:56.712773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:56.713250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:56.713682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:56.714369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:56.714818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:56.715240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:56.851846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:56.860309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c857b3ad-e2fe-4be1-90e7-d179134dbd37 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.158762 Aug 29 22:47:56.860879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 255/498] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:56 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:57.408593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:57.409238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:57.416197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:57.416682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:57.417117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:57.417808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:57.418253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:57.418669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:57.560784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:57.569398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-352a18dd-a462-4762-b318-d8bb145ebabd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.165044 Aug 29 22:47:57.569965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 244/499] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:57 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:57.881322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:57.881940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:57.888497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:57.889391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:57.889391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:57.890397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:57.890867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:57.891293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:58.089608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:58.098469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-46e07bf7-4b47-499a-a4f6-8e118b4107d6 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.221032 Aug 29 22:47:58.099050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 256/500] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:57 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:47:58.591115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:58.591715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:58.598647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:58.599120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:58.601094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:58.601094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:58.601094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:58.601094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:58.732414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:58.741286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5be10dab-ffbd-4b7c-be17-1101d42c1b8e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.154360 Aug 29 22:47:58.741863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 245/501] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:58 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:59.120777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:59.121373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:59.128053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:59.128625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:59.129074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:59.129874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:59.130478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:59.130915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:59.273305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:59.281741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e4d74d44-e9fb-4b42-a1a5-c44e97e9cebf tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.164774 Aug 29 22:47:59.282336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 257/502] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:59 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:47:59.449870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:47:59.453048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:59.459963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:59.460487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:59.460913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:59.461785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:59.462398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:59.462820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:59.488949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lazy-loading 'flavor' on Instance uuid 0a903cf9-0a2d-4391-ad67-ae87403930d7 {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:47:59.762862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:59.763470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:59.765856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:47:59.770770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:59.771251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:59.771714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:59.772421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:59.772877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:59.773481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:59.832831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fc9894dd-a22a-4101-9a61-ca2149665f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/action" status: 200 len: 32 microversion: 2.1 time: 0.387015 Aug 29 22:47:59.833760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 246/503] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:47:59 2022] POST /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/action => generated 32 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:47:59.845458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:47:59.853253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:47:59.854078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:59.854078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:59.854318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:59.855018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:59.855646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:59.856074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:59.932095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:47:59.940621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-724c1c50-c4ab-4b62-8ca4-30310b4e0040 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.181525 Aug 29 22:47:59.945206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 258/504] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:59 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:00.010843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:00.017889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-30a85ecb-1d9e-4633-a0ec-d9bc6de19ecc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.178447 Aug 29 22:48:00.018573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 247/505] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:47:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:00.302640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:00.303275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:00.305286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=8 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:00.310731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:00.314157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:00.314157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:00.314157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:00.314157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:00.314536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:00.513974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:00.523803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-664c007d-ed1a-47c0-81c4-dd58d05c8ee9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.224998 Aug 29 22:48:00.524510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 259/506] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:00 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:00.963015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:00.963627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:00.967631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:00.971369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:00.983614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:00.983614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:00.983614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:00.983614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:00.984174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:01.040047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:01.040954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:01.047645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:01.048177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:01.048618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:01.049288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:01.049735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:01.050146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:01.118255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:01.127291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aa8ba5b9-1d47-4bfb-a937-1acb0d41a4c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.168107 Aug 29 22:48:01.127877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 248/507] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:00 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:01.187999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:01.196510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-47ffa9e0-1366-4189-b7bd-c3d9d0c713fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160254 Aug 29 22:48:01.197081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 260/508] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:01.546568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:01.547173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:01.553377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:01.553857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:01.554289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:01.555025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:01.555474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:01.555889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:01.687500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:01.690913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:01.695457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-673a15e7-cd01-440e-a007-e5074de10be5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.153129 Aug 29 22:48:01.696025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 249/509] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:01 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:02.065656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-99a27acc-7f61-4481-85aa-741dc08dc42d req-28687894-6329-411a-987f-38067768d876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ddee20-0f21-4105-80d6-d388c1146f7d", "name": "network-vif-plugged", "status": "completed", "tag": "0e534abd-48b9-4065-800c-833daa6bb98c"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:02.075642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-99a27acc-7f61-4481-85aa-741dc08dc42d req-28687894-6329-411a-987f-38067768d876 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:02.076166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-99a27acc-7f61-4481-85aa-741dc08dc42d req-28687894-6329-411a-987f-38067768d876 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:02.076654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-99a27acc-7f61-4481-85aa-741dc08dc42d req-28687894-6329-411a-987f-38067768d876 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:02.087965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-99a27acc-7f61-4481-85aa-741dc08dc42d req-28687894-6329-411a-987f-38067768d876 service nova] Creating event network-vif-plugged:0e534abd-48b9-4065-800c-833daa6bb98c for instance 97ddee20-0f21-4105-80d6-d388c1146f7d on hv-cinder-85426 Aug 29 22:48:02.093458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-99a27acc-7f61-4481-85aa-741dc08dc42d req-28687894-6329-411a-987f-38067768d876 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032041 Aug 29 22:48:02.094013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 261/510] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:02.148489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:02.149102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:02.157617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:02.158103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:02.165063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:02.165063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:02.165063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:02.165063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:02.219902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:02.220620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:02.227040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:02.227674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:02.228124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:02.228852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:02.229301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:02.229719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:02.301328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:02.309892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b8ca6237-480f-4c0c-bed3-078988d06838 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.165386 Aug 29 22:48:02.310560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 250/511] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:02 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:02.366259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:02.375150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3feac244-ba1d-49b9-8f1e-e4e879e27c36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160463 Aug 29 22:48:02.375733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 262/512] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:02.718049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:02.718652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:02.724903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:02.725381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:02.725817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:02.726523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:02.727051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:02.727409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:02.864498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:02.872752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-94163acf-e627-4c02-800e-2d0365cbd240 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.158808 Aug 29 22:48:02.873334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 251/513] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:02 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:03.331659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:03.332386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:03.338765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:03.339241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:03.339665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:03.340462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:03.340936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:03.341322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:03.396509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:03.397113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:03.403768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:03.404290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:03.404758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:03.406402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:03.406848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:03.407265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:03.476187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:03.484802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e8276b10-3337-4f4d-b22b-e6a83558669e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.157182 Aug 29 22:48:03.485378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 263/514] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:03 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:03.546491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:03.554992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-620d5df2-5ea4-476b-ad03-7b85f193dfb3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162128 Aug 29 22:48:03.565380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 252/515] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:03.896154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:03.896759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:03.898754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:03.903397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:03.903880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:03.904349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:03.905180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:03.905641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:03.906113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:04.041596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:04.049890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-679fbe76-12b1-454a-ba7b-09c9d7b0eeb2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1679 microversion: 2.1 time: 0.157631 Aug 29 22:48:04.050490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 264/516] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:03 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:04.506065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:04.506663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:04.513296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:04.513769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:04.514200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:04.515141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:04.515403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:04.515804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:04.576575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:04.577190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:04.584618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:04.585194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:04.585632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:04.586346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:04.586801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:04.587227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:04.657658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:04.665534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c54a7d19-befc-4b1a-abb1-c5b251603b99 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1318 microversion: 2.1 time: 0.163430 Aug 29 22:48:04.666108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 253/517] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:04 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:04.725986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:04.735106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a1a6ff09-320e-46d1-9ae4-51825853a8c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162564 Aug 29 22:48:04.735761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 265/518] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:05.072802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:05.073478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:05.079480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.079952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.080493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.081467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.081910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.082315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.211301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:05.219856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-563f491a-3981-4c77-8856-325f720bd075 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1656 microversion: 2.1 time: 0.150990 Aug 29 22:48:05.220462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 254/519] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:05 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:05.240832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-54027d62-e27e-4edb-aa31-4faf97290692 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:05.246870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54027d62-e27e-4edb-aa31-4faf97290692 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.247346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54027d62-e27e-4edb-aa31-4faf97290692 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.247772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54027d62-e27e-4edb-aa31-4faf97290692 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.269917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-54027d62-e27e-4edb-aa31-4faf97290692 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Going to try to start instance {{(pid=128150) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 22:48:05.526431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-54027d62-e27e-4edb-aa31-4faf97290692 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/action" status: 202 len: 0 microversion: 2.1 time: 0.289088 Aug 29 22:48:05.526961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 266/520] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:48:05 2022] POST /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:48:05.535586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:05.536339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:05.542386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.542878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.543300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.543986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.544461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.544922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.685487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:05.688930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:05.689638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:05.694387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2f47e104-4577-4a39-bcc6-074e7d91cc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1665 microversion: 2.1 time: 0.162752 Aug 29 22:48:05.695132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 255/521] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:05 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:05.696290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.696785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.697220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.697929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.698377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.698794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.756853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:05.758874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:05.765625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.766189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.766689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.767448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.767971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.768515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.904389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:05.913761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a2e0bb29-450c-4356-85aa-e6bbd38858b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160763 Aug 29 22:48:05.928164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 256/522] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:05.928365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:05.928495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-662e59f9-7218-4e79-ad86-849e364925a8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1507 microversion: 2.1 time: 0.244898 Aug 29 22:48:05.929501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 267/523] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:05 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:05.953245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b3d8fd8e-2e57-4567-951e-ba70c64eedfe tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8857016a-8588-49bb-a41e-68b1fa5080d5", "device": "/dev/sdb"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:05.955686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b3d8fd8e-2e57-4567-951e-ba70c64eedfe tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:05.962083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3d8fd8e-2e57-4567-951e-ba70c64eedfe tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.962556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3d8fd8e-2e57-4567-951e-ba70c64eedfe tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.962989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3d8fd8e-2e57-4567-951e-ba70c64eedfe tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:05.963675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3d8fd8e-2e57-4567-951e-ba70c64eedfe tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:05.964125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3d8fd8e-2e57-4567-951e-ba70c64eedfe tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:05.965272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3d8fd8e-2e57-4567-951e-ba70c64eedfe tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:06.716481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:06.717125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:06.723733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:06.724415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:06.724857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:06.725554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:06.726011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:06.726435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:06.730783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:06.833330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b3d8fd8e-2e57-4567-951e-ba70c64eedfe tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "POST /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883494 Aug 29 22:48:06.837613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 257/524] 10.222.0.59 () {60 vars in 1323 bytes} [Mon Aug 29 22:48:05 2022] POST /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments => generated 194 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:06.876707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:06.885092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ac945bba-9fe4-4c98-9192-a87c9effc284 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1665 microversion: 2.1 time: 0.172583 Aug 29 22:48:06.885801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 268/525] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:06 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1665 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:06.938729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:06.939631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:06.946676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:06.947360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:06.948109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:06.948858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:06.949516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:06.949946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:07.097197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:07.105417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a50f3214-8608-4904-b35d-3acb69703033 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171730 Aug 29 22:48:07.105986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 258/526] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:07.908838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:07.909470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:07.917721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:07.918221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:07.918657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:07.919365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:07.919923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:07.920381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:08.050194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:08.058466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bc436297-e495-46b6-8805-713fd3b333dc tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1669 microversion: 2.1 time: 0.154618 Aug 29 22:48:08.059057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 269/527] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:07 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:08.127778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:08.128420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:08.134920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:08.135419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:08.135870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:08.136552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:08.137005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:08.137427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:08.268817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:08.277076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef59f8f0-c681-4967-8b77-4066bcd07ce1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.153948 Aug 29 22:48:08.281358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 259/528] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:09.298681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:09.299331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:09.305878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:09.306366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:09.306805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:09.307496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:09.307955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:09.308409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:09.441967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:09.450209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-59f628c6-2c02-4546-82af-bce80fed816a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155626 Aug 29 22:48:09.450765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 270/529] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:10.472498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:10.473168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:10.479867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:10.480394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:10.480830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:10.481531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:10.481961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:10.482411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:10.615367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:10.623766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dced16db-e8dc-48e8-a1d5-473e71e02aab tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155734 Aug 29 22:48:10.624370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 260/530] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:11.644812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:11.645419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:11.652004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:11.652511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:11.652944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:11.653631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:11.654083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:11.654503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:11.788632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:11.796796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-104e0f14-d3eb-4ede-b660-6b9924e0d1cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155874 Aug 29 22:48:11.797355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 271/531] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:12.819313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:12.819916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:12.826765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:12.827240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:12.827678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:12.828391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:12.828895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:12.829249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:12.967360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:12.976167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2369c834-175e-4bcd-8a54-43e66306217f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160700 Aug 29 22:48:12.976741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 261/532] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:13.999032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:13.999647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:14.006375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:14.006852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:14.007281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:14.008004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:14.008476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:14.008938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:14.137604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:14.146787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ec1941e8-6bf0-4e5f-bbd9-644441c48701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.152390 Aug 29 22:48:14.147358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 272/533] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:15.167879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:15.168514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:15.175448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:15.176403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:15.176890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:15.177575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:15.178026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:15.178445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:15.306618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:15.315579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dc15db16-1e66-4539-8c13-fcf9fe745217 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1716 microversion: 2.1 time: 0.151524 Aug 29 22:48:15.316347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 262/534] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:15.382333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:15.382869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:15.389993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:15.390488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:15.391809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:15.391809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:15.392307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:15.393279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:15.487064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] HTTP exception thrown: Cannot 'detach_volume' instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 while it is in vm_state rescued Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Request method failure captured: Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments/ab742603-e3e4-4f53-a40e-07794971b6aa HTTP/1.1 Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEw39NdTrxy5ryUt7omGBmI5smeJUc6U5eIQs41bdzVIByqPiCTClAVg1N75emU49t-aXJl3Vcrmpmm85kYfR_AR8Z9kJwiODBs4iNDGPP1tlx3n9rv2xGstyMmjtPKu_0hIY2-67xrpRyAazwfklpDKDMR7ps0Q4VwGdVpVV0pnkk Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 66de012537ed40e3bc233b80458bcfc4 Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:48:15.489137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_66de012537ed40e3bc233b80458bcfc4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 66de012537ed40e3bc233b80458bcfc4 Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-ServerRescueNegativeTestJSON-948463503-project Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: cc2f5c40aedf47dcb6374d64fcb04add Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948463503-project Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 22:48:15.490821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Cannot 'detach_volume' instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 while it is in vm_state rescued Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'server_id': '0a903cf9-0a2d-4391-ad67-ae87403930d7', 'id': 'ab742603-e3e4-4f53-a40e-07794971b6aa'} Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:15.491632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 while it is in vm_state rescued Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 while it is in vm_state rescued Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:15.493166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Returning 409 to user: Cannot 'detach_volume' instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 while it is in vm_state rescued {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:15.494519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bee5f5af-c996-4b24-9af8-79662d242376 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments/ab742603-e3e4-4f53-a40e-07794971b6aa" status: 409 len: 152 microversion: 2.1 time: 0.113847 Aug 29 22:48:15.494519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 273/535] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:48:15 2022] DELETE /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments/ab742603-e3e4-4f53-a40e-07794971b6aa => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 22:48:15.500695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-af93dd75-2db6-43ac-8b34-a8e86e39b718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:15.501246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-af93dd75-2db6-43ac-8b34-a8e86e39b718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:15.508741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af93dd75-2db6-43ac-8b34-a8e86e39b718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:15.509234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af93dd75-2db6-43ac-8b34-a8e86e39b718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:15.509670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af93dd75-2db6-43ac-8b34-a8e86e39b718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:15.510394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af93dd75-2db6-43ac-8b34-a8e86e39b718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:15.510922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af93dd75-2db6-43ac-8b34-a8e86e39b718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:15.511344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af93dd75-2db6-43ac-8b34-a8e86e39b718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:15.744664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-af93dd75-2db6-43ac-8b34-a8e86e39b718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/action" status: 202 len: 0 microversion: 2.1 time: 0.248098 Aug 29 22:48:15.745384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 263/536] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:48:15 2022] POST /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:48:15.754775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:15.755403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:15.763764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:15.764576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:15.765048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:15.765816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:15.766295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:15.766726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:16.005925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:16.015539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-df04e7af-0856-4b87-9657-8ac913958cec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.265391 Aug 29 22:48:16.016130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 274/537] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:17.048370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:17.050303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:17.056883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:17.057373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:17.057800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:17.058488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:17.058934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:17.059442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:17.063635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:17.200597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:17.210402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-102db893-fd33-463d-b689-fb859e1ada77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.166922 Aug 29 22:48:17.210975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 264/538] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:18.231666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:18.232242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:18.238887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:18.239371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:18.239805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:18.240567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:18.241007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:18.241429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:18.378646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:18.386922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-094dbc1f-9daa-4251-9d2c-880e7b254363 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.159147 Aug 29 22:48:18.387510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 275/539] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:19.410195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:19.410802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:19.418132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:19.418620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:19.419056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:19.419756 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:19.420250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:19.420676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:19.553988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:19.562668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cd07359d-8413-4868-8768-69296280f98e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.157389 Aug 29 22:48:19.563287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 265/540] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:20.438096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-32e4a349-7ff5-4543-a76d-7b697937e49a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:20.438759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-32e4a349-7ff5-4543-a76d-7b697937e49a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:20.445204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32e4a349-7ff5-4543-a76d-7b697937e49a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:20.449879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32e4a349-7ff5-4543-a76d-7b697937e49a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:20.449879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32e4a349-7ff5-4543-a76d-7b697937e49a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:20.449879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32e4a349-7ff5-4543-a76d-7b697937e49a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:20.449879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32e4a349-7ff5-4543-a76d-7b697937e49a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:20.450260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32e4a349-7ff5-4543-a76d-7b697937e49a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:20.479351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-32e4a349-7ff5-4543-a76d-7b697937e49a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments/bebb25dc-f73a-45b8-a590-96b331454771" status: 200 len: 194 microversion: 2.20 time: 0.045355 Aug 29 22:48:20.484386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 276/541] 10.222.0.59 () {60 vars in 1454 bytes} [Mon Aug 29 22:48:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments/bebb25dc-f73a-45b8-a590-96b331454771 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:20.547981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:20.548733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:20.555494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:20.556007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:20.556611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:20.557314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:20.557769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:20.558195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:20.586220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:20.586872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:20.593164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:20.593660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:20.594099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:20.594893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:20.595307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:20.596420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:20.649724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lazy-loading 'services' on Instance uuid 7e568957-b28a-4d75-b458-3f8e95bb38d0 {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:48:20.732543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:20.741242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-210a3e9e-5bc8-4374-80e5-fa79eac006cc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.159259 Aug 29 22:48:20.741800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 277/542] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:20.888861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8e2dcaec-a398-40cd-a5ff-cf2bfb1ee5fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments/bebb25dc-f73a-45b8-a590-96b331454771" status: 202 len: 0 microversion: 2.20 time: 0.344637 Aug 29 22:48:20.889455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 266/543] 10.222.0.59 () {60 vars in 1457 bytes} [Mon Aug 29 22:48:20 2022] DELETE /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments/bebb25dc-f73a-45b8-a590-96b331454771 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:48:20.898634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-27071190-1041-4880-921f-752a34eff932 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:20.900973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-27071190-1041-4880-921f-752a34eff932 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:20.907020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27071190-1041-4880-921f-752a34eff932 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:20.907497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27071190-1041-4880-921f-752a34eff932 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:20.907934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27071190-1041-4880-921f-752a34eff932 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:20.908647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27071190-1041-4880-921f-752a34eff932 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:20.909187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27071190-1041-4880-921f-752a34eff932 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:20.909627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27071190-1041-4880-921f-752a34eff932 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:20.941323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-27071190-1041-4880-921f-752a34eff932 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046651 Aug 29 22:48:20.941874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 278/544] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:21.763516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:21.764239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:21.771052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:21.771539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:21.771975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:21.772777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:21.773233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:21.773685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:21.911858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:21.920511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-af45df67-71c6-4ebc-a88d-f54299a3aa58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.161614 Aug 29 22:48:21.921428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 267/545] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:21.953932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c4c60af9-928c-4f8c-b68f-0d1c2ba0d945 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:21.956931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c4c60af9-928c-4f8c-b68f-0d1c2ba0d945 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:21.963670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4c60af9-928c-4f8c-b68f-0d1c2ba0d945 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:21.964186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4c60af9-928c-4f8c-b68f-0d1c2ba0d945 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:21.964625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4c60af9-928c-4f8c-b68f-0d1c2ba0d945 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:21.965319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4c60af9-928c-4f8c-b68f-0d1c2ba0d945 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:21.965776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4c60af9-928c-4f8c-b68f-0d1c2ba0d945 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:21.966200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4c60af9-928c-4f8c-b68f-0d1c2ba0d945 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:21.996806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c4c60af9-928c-4f8c-b68f-0d1c2ba0d945 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046837 Aug 29 22:48:21.997369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 279/546] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:22.943970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:22.944638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:22.951903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:22.952445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:22.952909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:22.953601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:22.954061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:22.954555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:23.013561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-15ac5c06-f32d-418f-80d3-67b62eb7b9d5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:23.017365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-15ac5c06-f32d-418f-80d3-67b62eb7b9d5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:23.028502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15ac5c06-f32d-418f-80d3-67b62eb7b9d5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:23.029339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15ac5c06-f32d-418f-80d3-67b62eb7b9d5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:23.030107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15ac5c06-f32d-418f-80d3-67b62eb7b9d5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:23.031394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15ac5c06-f32d-418f-80d3-67b62eb7b9d5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:23.032228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15ac5c06-f32d-418f-80d3-67b62eb7b9d5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:23.032882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15ac5c06-f32d-418f-80d3-67b62eb7b9d5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:23.078433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-15ac5c06-f32d-418f-80d3-67b62eb7b9d5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072406 Aug 29 22:48:23.079010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 280/547] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:48:23.117637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:23.126107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4fa51593-9734-428c-afcc-85dc802a7584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.186951 Aug 29 22:48:23.126617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 268/548] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:24.091925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a128550d-8a76-4638-a0f2-388d55d7d137 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:24.094550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a128550d-8a76-4638-a0f2-388d55d7d137 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:24.102617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a128550d-8a76-4638-a0f2-388d55d7d137 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:24.103115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a128550d-8a76-4638-a0f2-388d55d7d137 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:24.103555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a128550d-8a76-4638-a0f2-388d55d7d137 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:24.104320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a128550d-8a76-4638-a0f2-388d55d7d137 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:24.104785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a128550d-8a76-4638-a0f2-388d55d7d137 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:24.105205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a128550d-8a76-4638-a0f2-388d55d7d137 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:24.138963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a128550d-8a76-4638-a0f2-388d55d7d137 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051420 Aug 29 22:48:24.139552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 281/549] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:24.146938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:24.147548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:24.154454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:24.154944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:24.155373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:24.156098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:24.156571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:24.156986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:24.301192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:24.309833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-90694bab-e074-471f-8257-3e946f413c58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.166715 Aug 29 22:48:24.310477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 269/550] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:25.153812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-77ecede0-59a1-44e6-bcde-4debcd15e44d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:25.155971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-77ecede0-59a1-44e6-bcde-4debcd15e44d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:25.162761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77ecede0-59a1-44e6-bcde-4debcd15e44d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:25.163247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77ecede0-59a1-44e6-bcde-4debcd15e44d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:25.163706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77ecede0-59a1-44e6-bcde-4debcd15e44d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:25.165020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77ecede0-59a1-44e6-bcde-4debcd15e44d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:25.165468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77ecede0-59a1-44e6-bcde-4debcd15e44d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:25.165891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77ecede0-59a1-44e6-bcde-4debcd15e44d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:25.198009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-77ecede0-59a1-44e6-bcde-4debcd15e44d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048285 Aug 29 22:48:25.198506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 282/551] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:25.331010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:25.331878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:25.339573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:25.340086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:25.340528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:25.341221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:25.341667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:25.342118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:25.490924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:25.500156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-998f7d8f-a467-4788-b75c-1b5a60296f0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.172938 Aug 29 22:48:25.504499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 270/552] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:26.210999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-94226dc1-1d28-45fd-afa4-37d093d69fc0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:26.213045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-94226dc1-1d28-45fd-afa4-37d093d69fc0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:26.220786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94226dc1-1d28-45fd-afa4-37d093d69fc0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:26.221280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94226dc1-1d28-45fd-afa4-37d093d69fc0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:26.221713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94226dc1-1d28-45fd-afa4-37d093d69fc0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:26.222435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94226dc1-1d28-45fd-afa4-37d093d69fc0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:26.222888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94226dc1-1d28-45fd-afa4-37d093d69fc0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:26.223310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-94226dc1-1d28-45fd-afa4-37d093d69fc0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:26.257804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-94226dc1-1d28-45fd-afa4-37d093d69fc0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050866 Aug 29 22:48:26.258374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 283/553] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:26.522502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:26.523064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:26.530278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:26.530773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:26.531210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:26.531911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:26.532396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:26.532822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:26.680715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:26.689257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b91f23e0-0275-4008-917c-2dce9d02d37d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.170851 Aug 29 22:48:26.689841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 271/554] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:27.269770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7ea6f937-46a8-47b0-b9a9-589bc8ef5771 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:27.271912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7ea6f937-46a8-47b0-b9a9-589bc8ef5771 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:27.279217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea6f937-46a8-47b0-b9a9-589bc8ef5771 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:27.279700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea6f937-46a8-47b0-b9a9-589bc8ef5771 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:27.283142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea6f937-46a8-47b0-b9a9-589bc8ef5771 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:27.288559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea6f937-46a8-47b0-b9a9-589bc8ef5771 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:27.288559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea6f937-46a8-47b0-b9a9-589bc8ef5771 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:27.288559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ea6f937-46a8-47b0-b9a9-589bc8ef5771 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:27.312275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:27.317109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7ea6f937-46a8-47b0-b9a9-589bc8ef5771 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051312 Aug 29 22:48:27.318244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 284/555] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:27.712036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:27.712841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:27.719551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:27.720033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:27.720500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:27.721197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:27.721644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:27.722066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:27.859247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:27.868112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5d075dea-e695-41fb-8840-dc68f90eff58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.160664 Aug 29 22:48:27.868686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 272/556] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:28.329855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-41ef73c0-3e3b-491c-bf3b-dac18760b07b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:28.332345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-41ef73c0-3e3b-491c-bf3b-dac18760b07b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:28.339955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41ef73c0-3e3b-491c-bf3b-dac18760b07b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.340473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41ef73c0-3e3b-491c-bf3b-dac18760b07b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.340901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41ef73c0-3e3b-491c-bf3b-dac18760b07b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:28.341597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41ef73c0-3e3b-491c-bf3b-dac18760b07b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.342051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41ef73c0-3e3b-491c-bf3b-dac18760b07b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.342468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41ef73c0-3e3b-491c-bf3b-dac18760b07b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:28.373780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-41ef73c0-3e3b-491c-bf3b-dac18760b07b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047878 Aug 29 22:48:28.374378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 285/557] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:28.890030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:28.895629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:28.897388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.897916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.898385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:28.899105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.899567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.900082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:29.038391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:29.053137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1931297c-f82a-47db-8dae-12e9469c8573 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.166654 Aug 29 22:48:29.054081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 273/558] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:29.388034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8608d14f-044d-40c1-a269-bdda3aa5cfac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:29.390398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8608d14f-044d-40c1-a269-bdda3aa5cfac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:29.396974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8608d14f-044d-40c1-a269-bdda3aa5cfac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:29.397457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8608d14f-044d-40c1-a269-bdda3aa5cfac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:29.403215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8608d14f-044d-40c1-a269-bdda3aa5cfac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:29.403215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8608d14f-044d-40c1-a269-bdda3aa5cfac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:29.403215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8608d14f-044d-40c1-a269-bdda3aa5cfac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:29.403215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8608d14f-044d-40c1-a269-bdda3aa5cfac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:29.434184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8608d14f-044d-40c1-a269-bdda3aa5cfac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050167 Aug 29 22:48:29.434778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 286/559] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:30.087055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:30.087659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:30.094520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:30.095004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:30.095865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:30.096156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:30.097306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:30.097306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:30.233416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:30.242041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8af4899f-b747-4963-bede-8fbdbf065c80 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.159252 Aug 29 22:48:30.242674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 274/560] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:30.447740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-378bfb3d-c478-45f8-85f6-0f0b5094cc57 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:30.455147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-378bfb3d-c478-45f8-85f6-0f0b5094cc57 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:30.457037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-378bfb3d-c478-45f8-85f6-0f0b5094cc57 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:30.457515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-378bfb3d-c478-45f8-85f6-0f0b5094cc57 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:30.457942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-378bfb3d-c478-45f8-85f6-0f0b5094cc57 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:30.458634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-378bfb3d-c478-45f8-85f6-0f0b5094cc57 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:30.459084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-378bfb3d-c478-45f8-85f6-0f0b5094cc57 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:30.459502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-378bfb3d-c478-45f8-85f6-0f0b5094cc57 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:30.491856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-378bfb3d-c478-45f8-85f6-0f0b5094cc57 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048686 Aug 29 22:48:30.492471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 287/561] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:31.263296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:31.263912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:31.266533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=54 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:31.272031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:31.272547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:31.273014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:31.273732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:31.274176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:31.274628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:31.426464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:31.435610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8e577747-e306-455c-a70a-b5c1bddcc4b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.176401 Aug 29 22:48:31.436268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 275/562] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:31.504613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ab1f49df-2b08-4119-b0c4-bef711482cc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:31.506822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ab1f49df-2b08-4119-b0c4-bef711482cc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:31.513747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab1f49df-2b08-4119-b0c4-bef711482cc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:31.514150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab1f49df-2b08-4119-b0c4-bef711482cc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:31.514582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab1f49df-2b08-4119-b0c4-bef711482cc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:31.515277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab1f49df-2b08-4119-b0c4-bef711482cc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:31.515834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab1f49df-2b08-4119-b0c4-bef711482cc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:31.516165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab1f49df-2b08-4119-b0c4-bef711482cc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:31.550322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ab1f49df-2b08-4119-b0c4-bef711482cc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049783 Aug 29 22:48:31.550931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 288/563] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:32.457591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:32.458173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:32.465325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:32.465808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:32.466238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:32.466940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:32.467384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:32.467803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:32.564838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-70698de8-3aef-40e0-a733-1f65a254b7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:32.567476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-70698de8-3aef-40e0-a733-1f65a254b7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:32.574952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70698de8-3aef-40e0-a733-1f65a254b7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:32.575439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70698de8-3aef-40e0-a733-1f65a254b7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:32.575878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70698de8-3aef-40e0-a733-1f65a254b7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:32.576619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70698de8-3aef-40e0-a733-1f65a254b7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:32.577073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70698de8-3aef-40e0-a733-1f65a254b7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:32.577649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70698de8-3aef-40e0-a733-1f65a254b7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:32.609989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:32.611891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-70698de8-3aef-40e0-a733-1f65a254b7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052112 Aug 29 22:48:32.613479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 289/564] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:48:32.619028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2be9f26b-9532-41e8-92c3-c3c54625436b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.165462 Aug 29 22:48:32.619600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 276/565] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:33.626121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-210d30b6-9c03-45ae-b5ed-2751a1e3b051 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:33.628289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-210d30b6-9c03-45ae-b5ed-2751a1e3b051 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:33.639543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210d30b6-9c03-45ae-b5ed-2751a1e3b051 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:33.639543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210d30b6-9c03-45ae-b5ed-2751a1e3b051 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:33.639543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210d30b6-9c03-45ae-b5ed-2751a1e3b051 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:33.639543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210d30b6-9c03-45ae-b5ed-2751a1e3b051 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:33.640044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210d30b6-9c03-45ae-b5ed-2751a1e3b051 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:33.640044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-210d30b6-9c03-45ae-b5ed-2751a1e3b051 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:33.647098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:33.647697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:33.658326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:33.658850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:33.659293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:33.660015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:33.660503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:33.660934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:33.682382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-210d30b6-9c03-45ae-b5ed-2751a1e3b051 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059499 Aug 29 22:48:33.683414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 290/566] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:33.832535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:33.841433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6b969958-878d-415f-aa97-6a56741e0a06 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.198295 Aug 29 22:48:33.842001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 277/567] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:34.698286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4734a265-bc23-4cde-9581-a11aab9f767e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:34.700416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4734a265-bc23-4cde-9581-a11aab9f767e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:34.702733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=54 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:34.707698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4734a265-bc23-4cde-9581-a11aab9f767e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:34.708236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4734a265-bc23-4cde-9581-a11aab9f767e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:34.708667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4734a265-bc23-4cde-9581-a11aab9f767e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:34.709353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4734a265-bc23-4cde-9581-a11aab9f767e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:34.709800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4734a265-bc23-4cde-9581-a11aab9f767e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:34.710214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4734a265-bc23-4cde-9581-a11aab9f767e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:34.742933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4734a265-bc23-4cde-9581-a11aab9f767e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049211 Aug 29 22:48:34.743516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 291/568] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:34.863382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:34.863987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:34.871206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:34.871686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:34.872115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:34.872825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:34.873270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:34.873691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:35.008702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:35.017055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-399e95de-f134-498d-b8e3-4b0436a1f5d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.157488 Aug 29 22:48:35.017632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 278/569] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:35.755701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b6bf9e5d-54a7-49dd-96a0-4d2c3d3afce4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:35.758397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b6bf9e5d-54a7-49dd-96a0-4d2c3d3afce4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:35.765191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6bf9e5d-54a7-49dd-96a0-4d2c3d3afce4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:35.765676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6bf9e5d-54a7-49dd-96a0-4d2c3d3afce4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:35.766110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6bf9e5d-54a7-49dd-96a0-4d2c3d3afce4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:35.766803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6bf9e5d-54a7-49dd-96a0-4d2c3d3afce4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:35.767257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6bf9e5d-54a7-49dd-96a0-4d2c3d3afce4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:35.767682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6bf9e5d-54a7-49dd-96a0-4d2c3d3afce4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:35.798668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b6bf9e5d-54a7-49dd-96a0-4d2c3d3afce4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047363 Aug 29 22:48:35.799232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 292/570] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:36.039012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:36.039737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:36.046347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:36.046829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:36.047260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:36.047946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:36.048427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:36.048850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:36.188035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:36.197235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e0dc27c2-6394-4ccc-9e56-643ae8e3208e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.162266 Aug 29 22:48:36.197808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 279/571] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:36.811686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7058349d-a670-4d5d-9b96-4b65a838e6f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:36.813907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7058349d-a670-4d5d-9b96-4b65a838e6f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:36.821175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7058349d-a670-4d5d-9b96-4b65a838e6f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:36.821750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7058349d-a670-4d5d-9b96-4b65a838e6f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:36.822185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7058349d-a670-4d5d-9b96-4b65a838e6f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:36.822884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7058349d-a670-4d5d-9b96-4b65a838e6f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:36.823354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7058349d-a670-4d5d-9b96-4b65a838e6f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:36.823759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7058349d-a670-4d5d-9b96-4b65a838e6f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:36.854815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7058349d-a670-4d5d-9b96-4b65a838e6f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047059 Aug 29 22:48:36.855373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 293/572] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:37.218935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:37.219536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:37.225739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:37.226800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:37.227326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:37.228033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:37.228553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:37.228979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:37.233423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:37.370902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:37.379343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-648d81d9-a868-4857-a5e4-c9eaed440cd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.164770 Aug 29 22:48:37.380126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 280/573] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:37.867405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-39a62ed6-3399-4017-b87c-2178fc7438f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:37.870344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-39a62ed6-3399-4017-b87c-2178fc7438f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:37.876948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-39a62ed6-3399-4017-b87c-2178fc7438f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:37.877432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-39a62ed6-3399-4017-b87c-2178fc7438f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:37.877928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-39a62ed6-3399-4017-b87c-2178fc7438f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:37.878681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-39a62ed6-3399-4017-b87c-2178fc7438f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:37.879054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-39a62ed6-3399-4017-b87c-2178fc7438f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:37.879472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-39a62ed6-3399-4017-b87c-2178fc7438f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:37.911892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-39a62ed6-3399-4017-b87c-2178fc7438f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048686 Aug 29 22:48:37.912781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 294/574] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:38.402090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:38.402718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:38.409344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.409829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.410266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.410959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.411414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.411836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.455934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e4d28688-5559-4af9-9e62-cb1002d10530 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:38.456716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e4d28688-5559-4af9-9e62-cb1002d10530 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:38.463340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d28688-5559-4af9-9e62-cb1002d10530 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.463825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d28688-5559-4af9-9e62-cb1002d10530 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.464296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d28688-5559-4af9-9e62-cb1002d10530 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.464993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d28688-5559-4af9-9e62-cb1002d10530 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.465438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d28688-5559-4af9-9e62-cb1002d10530 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.465854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d28688-5559-4af9-9e62-cb1002d10530 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.490593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e4d28688-5559-4af9-9e62-cb1002d10530 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff/ips" status: 200 len: 149 microversion: 2.1 time: 0.039409 Aug 29 22:48:38.491269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 295/575] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 22:48:38 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:38.508336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f953de72-ac45-4cab-aa04-011d126c2934"}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:38.508336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:38.513144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.513632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.514069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.514772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.515216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.515634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.552173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:38.562113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-23381f50-5a22-45b7-ae60-0095468a0719 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.164565 Aug 29 22:48:38.562692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 281/576] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:38.604761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Invalid volume: volume f953de72-ac45-4cab-aa04-011d126c2934 is already attached to instances: 50bc49c0-59c8-4adc-9c9a-a43adb38c922 Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: POST /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff/os-volume_attachments HTTP/1.1 Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 74 Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:48:38.606444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {"volumeAttachment": {"volumeId": "f953de72-ac45-4cab-aa04-011d126c2934"}} Aug 29 22:48:38.608204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Invalid volume: volume f953de72-ac45-4cab-aa04-011d126c2934 is already attached to instances: 50bc49c0-59c8-4adc-9c9a-a43adb38c922 Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'server_id': '3f93cf86-a1d6-46b8-8b19-07daf0b193ff', 'body': {'volumeAttachment': {'volumeId': 'f953de72-ac45-4cab-aa04-011d126c2934'}}} Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f953de72-ac45-4cab-aa04-011d126c2934 is already attached to instances: 50bc49c0-59c8-4adc-9c9a-a43adb38c922 Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.609125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f953de72-ac45-4cab-aa04-011d126c2934 is already attached to instances: 50bc49c0-59c8-4adc-9c9a-a43adb38c922 Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:38.610913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:38.612499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:38.612499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:38.612499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:38.612499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f953de72-ac45-4cab-aa04-011d126c2934 is already attached to instances: 50bc49c0-59c8-4adc-9c9a-a43adb38c922 Aug 29 22:48:38.612499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:48:38.612499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 400 to user: Invalid volume: volume f953de72-ac45-4cab-aa04-011d126c2934 is already attached to instances: 50bc49c0-59c8-4adc-9c9a-a43adb38c922 {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:38.612499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0b7be91f-27b0-4ad7-9537-4796203fc7b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108061 Aug 29 22:48:38.612499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 296/577] 10.222.0.59 () {60 vars in 1323 bytes} [Mon Aug 29 22:48:38 2022] POST /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 22:48:38.617531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:38.618060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:38.624368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.624852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.625283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.625982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.626431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.626848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.655810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:48:38.925480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-919cd716-5931-4aa6-9c25-d667fe80d802 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:38.927680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-919cd716-5931-4aa6-9c25-d667fe80d802 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:38.935883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-919cd716-5931-4aa6-9c25-d667fe80d802 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.936358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-33d16a70-28f6-4d9d-ac65-78fd4153239d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 204 len: 0 microversion: 2.1 time: 0.322857 Aug 29 22:48:38.936501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-919cd716-5931-4aa6-9c25-d667fe80d802 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.936943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-919cd716-5931-4aa6-9c25-d667fe80d802 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.937099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 282/578] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 22:48:38 2022] DELETE /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:48:38.937667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-919cd716-5931-4aa6-9c25-d667fe80d802 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.938113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-919cd716-5931-4aa6-9c25-d667fe80d802 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.938538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-919cd716-5931-4aa6-9c25-d667fe80d802 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.946010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:38.946707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:38.953066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.956010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.956010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.956010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.956010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.956676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.970803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-919cd716-5931-4aa6-9c25-d667fe80d802 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049342 Aug 29 22:48:38.971570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 297/579] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:48:39.100500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:39.109390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bef46bd3-b869-442e-96bd-bbfd62c1799f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.167885 Aug 29 22:48:39.109968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 283/580] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:38 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:39.584997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:39.585995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:39.592069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:39.592588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:39.593021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:39.593735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:39.594209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:39.594791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:39.732724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:39.741100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-862b96fe-031e-4412-98f3-f76c457e02b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.160402 Aug 29 22:48:39.741791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 298/581] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:39.985378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-81966e50-4ef6-4fc1-9d92-c25f8b3ca11a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:39.987644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-81966e50-4ef6-4fc1-9d92-c25f8b3ca11a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:39.994249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81966e50-4ef6-4fc1-9d92-c25f8b3ca11a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:39.994709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81966e50-4ef6-4fc1-9d92-c25f8b3ca11a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:39.995134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81966e50-4ef6-4fc1-9d92-c25f8b3ca11a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:39.995816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81966e50-4ef6-4fc1-9d92-c25f8b3ca11a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:39.996296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81966e50-4ef6-4fc1-9d92-c25f8b3ca11a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:39.996763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81966e50-4ef6-4fc1-9d92-c25f8b3ca11a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:40.026149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-81966e50-4ef6-4fc1-9d92-c25f8b3ca11a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044734 Aug 29 22:48:40.026707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 284/582] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:40.130740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:40.131351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:40.138680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:40.139164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:40.139810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:40.140633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:40.141087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:40.141506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:40.277921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:40.285794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0069baa7-3b3d-4aa4-aeb3-c46a3356552a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.159056 Aug 29 22:48:40.286581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 299/583] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:40 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:40.763776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:40.764450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:40.770575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:40.771062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:40.771495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:40.772227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:40.772683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:40.773334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:40.907508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:40.916532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ebf7e9a2-87d5-45b4-94fe-a513c0ede902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.156545 Aug 29 22:48:40.917360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 285/584] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:41.039362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-10428d27-0f7d-422d-8be0-a29895d0dfae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:41.041786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-10428d27-0f7d-422d-8be0-a29895d0dfae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:41.047968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10428d27-0f7d-422d-8be0-a29895d0dfae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.048492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10428d27-0f7d-422d-8be0-a29895d0dfae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.048929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10428d27-0f7d-422d-8be0-a29895d0dfae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:41.049635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10428d27-0f7d-422d-8be0-a29895d0dfae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.050089 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10428d27-0f7d-422d-8be0-a29895d0dfae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.050515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10428d27-0f7d-422d-8be0-a29895d0dfae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:41.081844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-10428d27-0f7d-422d-8be0-a29895d0dfae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046903 Aug 29 22:48:41.082422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 300/585] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:41.308919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:41.309540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:41.316202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.316704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.317135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:41.317814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.318261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.318682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:41.458056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:41.467293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a1000cf5-6f8c-472a-a324-5d5f8b891c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.162934 Aug 29 22:48:41.467885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 286/586] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:41 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:41.938560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:41.939134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:41.947410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.947905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.948383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:41.949419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.949596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.950494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:42.097123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2c85c6ae-2513-4a36-9bb3-f8ce1cf64794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:42.100046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2c85c6ae-2513-4a36-9bb3-f8ce1cf64794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:42.107163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c85c6ae-2513-4a36-9bb3-f8ce1cf64794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:42.107640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c85c6ae-2513-4a36-9bb3-f8ce1cf64794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:42.108116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c85c6ae-2513-4a36-9bb3-f8ce1cf64794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:42.108851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c85c6ae-2513-4a36-9bb3-f8ce1cf64794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:42.109297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c85c6ae-2513-4a36-9bb3-f8ce1cf64794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:42.109720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c85c6ae-2513-4a36-9bb3-f8ce1cf64794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:42.109827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:42.112063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:42.119191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8f8f160e-1eac-4ffa-a669-b488f405fac3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.184635 Aug 29 22:48:42.119777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 301/587] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:42.140579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2c85c6ae-2513-4a36-9bb3-f8ce1cf64794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049354 Aug 29 22:48:42.141155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 287/588] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:48:42.491031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:42.491810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:42.498746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:42.500813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:42.500813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:42.500813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:42.502991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:42.502991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:42.651051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:42.659054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d342b595-6c77-4ca3-8ebc-868320dc40cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.173420 Aug 29 22:48:42.659630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 302/589] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:42 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:43.141548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:43.142220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:43.151239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.151972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.152733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.153458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.154069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.154228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6d11b50d-8877-4ce2-8d24-8378f0fb3f8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:43.154899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.156770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6d11b50d-8877-4ce2-8d24-8378f0fb3f8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:43.163491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d11b50d-8877-4ce2-8d24-8378f0fb3f8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.164648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d11b50d-8877-4ce2-8d24-8378f0fb3f8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.165083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d11b50d-8877-4ce2-8d24-8378f0fb3f8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.165896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d11b50d-8877-4ce2-8d24-8378f0fb3f8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.166248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d11b50d-8877-4ce2-8d24-8378f0fb3f8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.166884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d11b50d-8877-4ce2-8d24-8378f0fb3f8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.200624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6d11b50d-8877-4ce2-8d24-8378f0fb3f8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051966 Aug 29 22:48:43.201124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 303/590] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:48:43.350506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:43.366522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1a1a9e74-1ec7-4bf5-965c-057bc3e3b185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.228398 Aug 29 22:48:43.367525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 288/591] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:43.687053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:43.688245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:43.700020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.700894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.701658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.702916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.703835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.704688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.916855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:43.934722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a9df21df-dd3a-4eb8-bd1b-c490dfb2b177 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.255173 Aug 29 22:48:43.935852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 304/592] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:43 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:44.214717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-33c5feb6-7127-4cd8-86e1-2f9f344c965c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:44.216922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-33c5feb6-7127-4cd8-86e1-2f9f344c965c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:44.224509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33c5feb6-7127-4cd8-86e1-2f9f344c965c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.225072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33c5feb6-7127-4cd8-86e1-2f9f344c965c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.225546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33c5feb6-7127-4cd8-86e1-2f9f344c965c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:44.226916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33c5feb6-7127-4cd8-86e1-2f9f344c965c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.227412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33c5feb6-7127-4cd8-86e1-2f9f344c965c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.227843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33c5feb6-7127-4cd8-86e1-2f9f344c965c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:44.266214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-33c5feb6-7127-4cd8-86e1-2f9f344c965c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056499 Aug 29 22:48:44.266850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 289/593] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:44.402052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:44.402680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:44.412482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.412975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.413558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:44.414986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.415451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.415880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:44.562933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:44.571893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-905033aa-2e85-4323-a5b4-f307f6572304 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.174698 Aug 29 22:48:44.572593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 305/594] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:44.964760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:44.965409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:44.972343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.973034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.973825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:44.974636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.975287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.975989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:45.201200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:45.209513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-544be0b3-65f0-4890-96ce-fd30c63bc1cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.249978 Aug 29 22:48:45.210131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 290/595] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:44 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:45.280551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dce563e3-c02e-4187-a577-36baa49cd522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:45.282991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dce563e3-c02e-4187-a577-36baa49cd522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:45.291236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dce563e3-c02e-4187-a577-36baa49cd522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:45.292088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dce563e3-c02e-4187-a577-36baa49cd522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:45.292857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dce563e3-c02e-4187-a577-36baa49cd522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:45.294117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dce563e3-c02e-4187-a577-36baa49cd522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:45.294843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dce563e3-c02e-4187-a577-36baa49cd522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:45.295574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dce563e3-c02e-4187-a577-36baa49cd522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:45.339032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dce563e3-c02e-4187-a577-36baa49cd522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062884 Aug 29 22:48:45.340199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 306/596] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:48:45.595312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:45.595937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:45.603394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:45.604368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:45.605073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:45.606205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:45.606934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:45.607620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:45.787090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:45.796396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c867d5b3-7a8f-4aae-b760-34956eded51c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.205325 Aug 29 22:48:45.797006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 291/597] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:46.233428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:46.234309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:46.241134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.241739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.242349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.243053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.243504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.243922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.354373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-171bdf40-d45f-4606-a119-ba7c8fad41c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:46.356811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-171bdf40-d45f-4606-a119-ba7c8fad41c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:46.363170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171bdf40-d45f-4606-a119-ba7c8fad41c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.363655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171bdf40-d45f-4606-a119-ba7c8fad41c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.364090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171bdf40-d45f-4606-a119-ba7c8fad41c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.364813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171bdf40-d45f-4606-a119-ba7c8fad41c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.365425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171bdf40-d45f-4606-a119-ba7c8fad41c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.365853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171bdf40-d45f-4606-a119-ba7c8fad41c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.400619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-171bdf40-d45f-4606-a119-ba7c8fad41c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050092 Aug 29 22:48:46.402359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 292/598] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:48:46.403097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:46.411483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1422cb4c-6749-4a76-8eaa-e2be235d9503 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.182266 Aug 29 22:48:46.412090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 307/599] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:46 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:46.819223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:46.820247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:46.827605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.828078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.828595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.829284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.829729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.830142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.969360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-59fb2f13-5d94-4d3d-8636-0469647e6428 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:46.973435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-59fb2f13-5d94-4d3d-8636-0469647e6428 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:46.983315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59fb2f13-5d94-4d3d-8636-0469647e6428 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.984275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59fb2f13-5d94-4d3d-8636-0469647e6428 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.985067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59fb2f13-5d94-4d3d-8636-0469647e6428 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.986413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59fb2f13-5d94-4d3d-8636-0469647e6428 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.987258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59fb2f13-5d94-4d3d-8636-0469647e6428 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.994501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59fb2f13-5d94-4d3d-8636-0469647e6428 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.012764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:47.024730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e7d4f7d2-d1b2-40a5-8333-6ea0aa65bd6f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.209273 Aug 29 22:48:47.028270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 293/600] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:46 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:47.045594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-59fb2f13-5d94-4d3d-8636-0469647e6428 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084645 Aug 29 22:48:47.046609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 308/601] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:48:46 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 22:48:47.120507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:47.120967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:47.127152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.131462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.131462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.131462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.131462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.131883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.159190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:48:47.177054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:47.416935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-830708ab-d785-4d01-bc19-ae5b3f3f7a87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:47.420197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-830708ab-d785-4d01-bc19-ae5b3f3f7a87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:47.427676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-830708ab-d785-4d01-bc19-ae5b3f3f7a87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.428183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-830708ab-d785-4d01-bc19-ae5b3f3f7a87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.428629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-830708ab-d785-4d01-bc19-ae5b3f3f7a87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.429368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-830708ab-d785-4d01-bc19-ae5b3f3f7a87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.430011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-830708ab-d785-4d01-bc19-ae5b3f3f7a87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.431264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-830708ab-d785-4d01-bc19-ae5b3f3f7a87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.465173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-830708ab-d785-4d01-bc19-ae5b3f3f7a87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054959 Aug 29 22:48:47.465780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 309/602] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:48:47.470788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:47.471555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:47.478958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.479569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.479989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.480733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.481258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.481691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.605612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-57cfc0a8-eb6e-49b0-8dec-8817bac12eed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 204 len: 0 microversion: 2.1 time: 0.489568 Aug 29 22:48:47.606647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 294/603] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 22:48:47 2022] DELETE /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:48:47.615204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:47.619379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:47.636455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.636455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.636455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.636455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.636841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:47.636951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.636951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.637409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c6095c5e-a878-415f-a4e7-e37a55c73b1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.170425 Aug 29 22:48:47.637992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 310/604] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:47 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:47.773712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:47.782337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f4e5dca0-5e60-47fb-9cb0-263f292b1fed tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.171357 Aug 29 22:48:47.783005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 295/605] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:47 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:48.048268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:48.048811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:48.056634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.057260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.057795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.058565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.059334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.059765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.216784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:48.225767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ea4f7bcc-a950-4951-9625-d39a8e012152 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.181852 Aug 29 22:48:48.226413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 311/606] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:48.481543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2e5ddf2f-f883-4a02-ba82-92952a52d782 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:48.484056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2e5ddf2f-f883-4a02-ba82-92952a52d782 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:48.492909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e5ddf2f-f883-4a02-ba82-92952a52d782 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.493742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e5ddf2f-f883-4a02-ba82-92952a52d782 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.494089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e5ddf2f-f883-4a02-ba82-92952a52d782 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.498329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e5ddf2f-f883-4a02-ba82-92952a52d782 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.498329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e5ddf2f-f883-4a02-ba82-92952a52d782 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.498329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e5ddf2f-f883-4a02-ba82-92952a52d782 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.539330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2e5ddf2f-f883-4a02-ba82-92952a52d782 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062181 Aug 29 22:48:48.540103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 296/607] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:48.660284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:48.660887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:48.668056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.668572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.668995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.669684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.670129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.670542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.805288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:48.805913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:48.812130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.812654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.813070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.813760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.814209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.814665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.814854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:48.823265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5504dae1-9d3f-425f-a976-4bc0b8011f1c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.166839 Aug 29 22:48:48.823861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 312/608] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:48 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:48.955780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:48.971059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d38ee8ca-feeb-4848-a9b7-a71c1f4d15da tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.170364 Aug 29 22:48:48.971652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 297/609] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:48 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:49.247738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:49.248385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:49.254761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.255242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.255670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.256396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.256846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.257791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.453491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:49.462825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eafca653-1a33-4106-bd27-c06dd4379893 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.219189 Aug 29 22:48:49.463408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 313/610] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:49 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:49.555097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-29ada5b1-f01f-4b78-933a-f9c3b549aae1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:49.557242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-29ada5b1-f01f-4b78-933a-f9c3b549aae1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:49.564079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29ada5b1-f01f-4b78-933a-f9c3b549aae1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.564591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29ada5b1-f01f-4b78-933a-f9c3b549aae1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.565033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29ada5b1-f01f-4b78-933a-f9c3b549aae1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.565745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29ada5b1-f01f-4b78-933a-f9c3b549aae1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.566183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29ada5b1-f01f-4b78-933a-f9c3b549aae1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.566606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29ada5b1-f01f-4b78-933a-f9c3b549aae1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.598654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-29ada5b1-f01f-4b78-933a-f9c3b549aae1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048338 Aug 29 22:48:49.599222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 298/611] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:49.845541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:49.846093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:49.854043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.854530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.854964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.855703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.856178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.856613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.993254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:49.993401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:49.993875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:49.999921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.000497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.000936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.001268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2748174f-4a9e-454e-87e9-72caa192647e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.159677 Aug 29 22:48:50.001632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.001853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 314/612] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:49 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:50.002087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.002518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.140689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:50.148618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7c6ac41b-f723-46ad-9cce-13dcb926e2bd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.159288 Aug 29 22:48:50.149235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 299/613] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:49 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:50.484552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:50.485080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:50.491112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.492185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.492622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.493460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.493905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.494373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.612557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-150d5444-8073-416d-8a72-a06047771f54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:50.614717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-150d5444-8073-416d-8a72-a06047771f54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:50.622709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-150d5444-8073-416d-8a72-a06047771f54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.623392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-150d5444-8073-416d-8a72-a06047771f54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.623826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-150d5444-8073-416d-8a72-a06047771f54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.624592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-150d5444-8073-416d-8a72-a06047771f54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.625054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-150d5444-8073-416d-8a72-a06047771f54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.625480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-150d5444-8073-416d-8a72-a06047771f54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.632947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:50.641481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4d3e1e56-8e55-4c1c-b437-af24faadc65d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.160867 Aug 29 22:48:50.642068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 315/614] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:50.658045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-150d5444-8073-416d-8a72-a06047771f54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049712 Aug 29 22:48:50.658582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 300/615] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:51.024714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:51.025620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:51.032559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.033098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.033591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.034356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.034826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.035250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.170780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:51.171354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:51.177430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.177924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.178363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.179337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.179730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.180237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.189267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:51.197620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e3d8d7bd-d2bc-4c9e-8054-14a51de78592 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.177746 Aug 29 22:48:51.198207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 316/616] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:51 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:51.312708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:51.320646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f1e01099-d13b-4dca-a374-a5bc86803601 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.153882 Aug 29 22:48:51.321219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 301/617] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:51 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:51.662985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:51.664219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:51.670416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.670996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.671434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.671615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2db8e4be-7656-4d99-bb29-e2e054502a48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:51.672239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.672594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.673010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.674053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2db8e4be-7656-4d99-bb29-e2e054502a48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:51.683375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db8e4be-7656-4d99-bb29-e2e054502a48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.684001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db8e4be-7656-4d99-bb29-e2e054502a48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.684603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db8e4be-7656-4d99-bb29-e2e054502a48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.685895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db8e4be-7656-4d99-bb29-e2e054502a48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.686473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db8e4be-7656-4d99-bb29-e2e054502a48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.687010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db8e4be-7656-4d99-bb29-e2e054502a48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.721933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2db8e4be-7656-4d99-bb29-e2e054502a48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054966 Aug 29 22:48:51.722589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 302/618] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:48:51.812803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:51.822286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7977de7c-8f5f-4024-ad65-a5fe35f60992 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.163103 Aug 29 22:48:51.822952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 317/619] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:52.219048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.219574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:52.226402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.227369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.227723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.228457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.228908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.229329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.344532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.344532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:52.350537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.351562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.352034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.352830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.353322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.353763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.367372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:52.371078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:52.376109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6de8f590-1ca1-4c4f-b40f-834685545110 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.160827 Aug 29 22:48:52.376723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 303/620] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:52.499189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:52.507184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ce410bf3-b8a4-4c76-8c8f-23bbf7b92d58 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.168535 Aug 29 22:48:52.507766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 318/621] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:52.844646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.845263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:52.845863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-74e7e6a0-ccfb-47d1-a670-555ca8fb7ca0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.848238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-74e7e6a0-ccfb-47d1-a670-555ca8fb7ca0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:52.852300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.852869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.853383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.854165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.854695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.855116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74e7e6a0-ccfb-47d1-a670-555ca8fb7ca0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.855266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.855601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74e7e6a0-ccfb-47d1-a670-555ca8fb7ca0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.856035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74e7e6a0-ccfb-47d1-a670-555ca8fb7ca0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.856752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74e7e6a0-ccfb-47d1-a670-555ca8fb7ca0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.857207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74e7e6a0-ccfb-47d1-a670-555ca8fb7ca0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.857627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74e7e6a0-ccfb-47d1-a670-555ca8fb7ca0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.890502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-74e7e6a0-ccfb-47d1-a670-555ca8fb7ca0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159723 Aug 29 22:48:52.895408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 304/622] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:52.993658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:53.002630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c5669f40-34ab-45da-abcd-6a46cd691160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.161632 Aug 29 22:48:53.003211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 319/623] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:53.397126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.397774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:53.404316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.404787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.405211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.405895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.406335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.406749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.529663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.530354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:53.542622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.543112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.543552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.544396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.544862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.545289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.561591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:53.570459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f77e1fb4-8644-4b93-adb7-d23d3ba607aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.176667 Aug 29 22:48:53.571565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 305/624] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:53.689605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:53.698185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4bd660a2-f6a1-4935-bf4e-70596d4dd877 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.172533 Aug 29 22:48:53.698779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 320/625] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:53.906399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-096cc071-be0f-4ccb-822c-7873d37e7bc7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.908632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-096cc071-be0f-4ccb-822c-7873d37e7bc7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:53.915770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-096cc071-be0f-4ccb-822c-7873d37e7bc7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.916318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-096cc071-be0f-4ccb-822c-7873d37e7bc7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.916830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-096cc071-be0f-4ccb-822c-7873d37e7bc7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.917546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-096cc071-be0f-4ccb-822c-7873d37e7bc7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.917999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-096cc071-be0f-4ccb-822c-7873d37e7bc7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.918460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-096cc071-be0f-4ccb-822c-7873d37e7bc7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.954822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-096cc071-be0f-4ccb-822c-7873d37e7bc7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053096 Aug 29 22:48:53.955482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 306/626] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:54.026576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.027238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:54.034151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.034805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.035452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.036311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.036866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.037420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.172257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:54.181301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5a2b1107-83a9-49f1-b7e9-8e9892657ca1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.159736 Aug 29 22:48:54.182021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 321/627] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:54.592928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.593444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:54.599940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.600473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.600916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.601745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.602204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.602933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.722951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.723617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:54.730580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.731058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.731904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.732569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.733031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.733446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.743561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:54.751712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4653f2bb-fe34-49ea-ab35-39e819dd020c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.162721 Aug 29 22:48:54.752340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 307/628] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:54 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:54.885309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:54.893761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e0a55f37-ca59-42e7-a02d-21a54374d045 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.174621 Aug 29 22:48:54.894362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 322/629] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:54 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:54.967449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7954ec17-b81e-41ab-9a6a-df98809ac4ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.969774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7954ec17-b81e-41ab-9a6a-df98809ac4ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:54.976057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7954ec17-b81e-41ab-9a6a-df98809ac4ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.976959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7954ec17-b81e-41ab-9a6a-df98809ac4ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.977119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7954ec17-b81e-41ab-9a6a-df98809ac4ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.977776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7954ec17-b81e-41ab-9a6a-df98809ac4ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.978250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7954ec17-b81e-41ab-9a6a-df98809ac4ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.978675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7954ec17-b81e-41ab-9a6a-df98809ac4ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.014067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7954ec17-b81e-41ab-9a6a-df98809ac4ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050699 Aug 29 22:48:55.014648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 308/630] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:55.204014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:55.204582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:55.210953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.211539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.211978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.212725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.213181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.213607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.351653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:55.359898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-906cdf75-02d6-49f4-91a4-c945f64a23a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.160012 Aug 29 22:48:55.360506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 323/631] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:55.774327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:55.774935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:55.782224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.782708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.783143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.783846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.784342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.784802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.917638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:55.918994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:55.931171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.931652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.932086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.932812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.933363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.933678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.935613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:55.943451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-85269b18-a6d8-4e2c-baca-6e9a6804434c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.172935 Aug 29 22:48:55.945045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 309/632] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:55 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:56.029894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-39dac214-61e7-413f-93db-7241457522a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:56.033099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-39dac214-61e7-413f-93db-7241457522a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:56.043021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39dac214-61e7-413f-93db-7241457522a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.043804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39dac214-61e7-413f-93db-7241457522a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.044545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39dac214-61e7-413f-93db-7241457522a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.045621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39dac214-61e7-413f-93db-7241457522a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.046106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39dac214-61e7-413f-93db-7241457522a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.046679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39dac214-61e7-413f-93db-7241457522a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.053065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:56.085795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-39dac214-61e7-413f-93db-7241457522a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061699 Aug 29 22:48:56.086891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 310/633] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:56.104176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:56.112041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d2d9fd81-61af-4277-9f34-c60003351f66 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.199139 Aug 29 22:48:56.112639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 324/634] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:55 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:56.384868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:56.385830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:56.393017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.393416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.393859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.394566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.395019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.395445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.547279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:56.556392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2a10747d-2af0-4aed-aac5-63843a4eaf02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.177093 Aug 29 22:48:56.556981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 311/635] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:56.978582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:56.979712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:56.985727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.992326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.992326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.992326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.992326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.992757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.102740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-35892475-d67b-446d-86b4-a4ec860f951f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:57.105819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-35892475-d67b-446d-86b4-a4ec860f951f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:57.113645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35892475-d67b-446d-86b4-a4ec860f951f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.114218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35892475-d67b-446d-86b4-a4ec860f951f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.114658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35892475-d67b-446d-86b4-a4ec860f951f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.115360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35892475-d67b-446d-86b4-a4ec860f951f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.115835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35892475-d67b-446d-86b4-a4ec860f951f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.116306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35892475-d67b-446d-86b4-a4ec860f951f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.141482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:57.151205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c7892a2d-7c71-4f53-9ee4-8dae8d9ffe68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.176754 Aug 29 22:48:57.151779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 325/636] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:56 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:57.164213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-35892475-d67b-446d-86b4-a4ec860f951f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059996 Aug 29 22:48:57.164213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 312/637] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:57.164633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:57.164633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:57.167760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.167760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.169773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.169773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.169976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.170249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.313227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:57.321772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-864ffe01-0236-4300-a35b-f5258112dea9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.167642 Aug 29 22:48:57.323572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 326/638] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:57 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:57.578687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:57.579212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:57.585652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.586260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.586734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.587528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.587988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.588448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.717152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:57.725418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1447fe11-54fd-4b8f-bc0b-9cc1ec4c3162 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.150812 Aug 29 22:48:57.726543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 313/639] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:58.173168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-48b119f4-4652-4cae-abf8-037f6abb68a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:58.174221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:58.174836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:58.175420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-48b119f4-4652-4cae-abf8-037f6abb68a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:58.182603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.183278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.183409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b119f4-4652-4cae-abf8-037f6abb68a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.183712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.183887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b119f4-4652-4cae-abf8-037f6abb68a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.184350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b119f4-4652-4cae-abf8-037f6abb68a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.184482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.184939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.185060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b119f4-4652-4cae-abf8-037f6abb68a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.185363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.185462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b119f4-4652-4cae-abf8-037f6abb68a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.185876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b119f4-4652-4cae-abf8-037f6abb68a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.224674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-48b119f4-4652-4cae-abf8-037f6abb68a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055884 Aug 29 22:48:58.225261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 327/640] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:58.344428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.347885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:58.348590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:58.353004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fc5a56b9-a1d6-4b18-aa58-0e752a6f8fcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.183028 Aug 29 22:48:58.355372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.355866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.356387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.357067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 314/641] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:58 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:58.357193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.357482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.357919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.500369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.509270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1b8d9855-e5a9-4cf4-9725-29e3eb94ea0c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.168342 Aug 29 22:48:58.509864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 328/642] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:58 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:58.747524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:58.748050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:58.754294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.754775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.755213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.755929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.756425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.756851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.898230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.907337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5ebb89dd-c50f-4b3d-bd2a-5cd90d8e4576 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.163726 Aug 29 22:48:58.908337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 315/643] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:59.237568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-78dfebc9-1915-4a1b-99a7-ad2d259f0270 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:59.239933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-78dfebc9-1915-4a1b-99a7-ad2d259f0270 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:59.247605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78dfebc9-1915-4a1b-99a7-ad2d259f0270 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.248209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78dfebc9-1915-4a1b-99a7-ad2d259f0270 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.248697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78dfebc9-1915-4a1b-99a7-ad2d259f0270 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.249411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78dfebc9-1915-4a1b-99a7-ad2d259f0270 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.249870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78dfebc9-1915-4a1b-99a7-ad2d259f0270 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.250295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78dfebc9-1915-4a1b-99a7-ad2d259f0270 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.284324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-78dfebc9-1915-4a1b-99a7-ad2d259f0270 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050653 Aug 29 22:48:59.284922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 329/644] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:48:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:48:59.375002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:59.375609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:59.382496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.383340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.383780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.384511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.384966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.385387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.536330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:59.548675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ba301985-f1a6-426c-b097-35efb7a3a322 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.177045 Aug 29 22:48:59.549841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 316/645] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:59 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:59.651813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:59.652447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:59.667982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.667982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.667982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.667982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.668508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.668508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.801889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:59.810336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b7d82107-7ac5-4d4b-880d-2488d301e04d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.283119 Aug 29 22:48:59.810951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 330/646] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:59 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:59.934208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:59.934820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:59.941944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.942827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.942977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.943566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.944020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.944475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.094490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:00.103123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-56a09c31-84e1-4e7a-be6a-282953cac07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.173694 Aug 29 22:49:00.103876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 317/647] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:00.296534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fdd9e45a-1375-4bda-9ae4-3f04a87ab898 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:00.298792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fdd9e45a-1375-4bda-9ae4-3f04a87ab898 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:00.305904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd9e45a-1375-4bda-9ae4-3f04a87ab898 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.306390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd9e45a-1375-4bda-9ae4-3f04a87ab898 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.306823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd9e45a-1375-4bda-9ae4-3f04a87ab898 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.307524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd9e45a-1375-4bda-9ae4-3f04a87ab898 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.308012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd9e45a-1375-4bda-9ae4-3f04a87ab898 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.308465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd9e45a-1375-4bda-9ae4-3f04a87ab898 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.339295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fdd9e45a-1375-4bda-9ae4-3f04a87ab898 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046738 Aug 29 22:49:00.339860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 331/648] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:00.572924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:00.573798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:00.580676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.580965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.581649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.582341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.582781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.583210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.746716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:00.754947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4e175bbd-6150-4ffc-b1a7-64acd39806c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.185805 Aug 29 22:49:00.755697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 318/649] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:00 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:00.833084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:00.833619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:00.839999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.840538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.840969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.841669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.842118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.842537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.986479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:00.995043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-91f8625a-af0f-4f66-a685-fa15de6c3856 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.166121 Aug 29 22:49:00.995625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 332/650] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:00 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:01.126654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:01.127321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:01.129661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:01.135641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.136121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.136581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.137279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.137727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.138145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.285467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:01.294109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b6bb9f46-b408-4925-8f06-4b917404f061 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.171249 Aug 29 22:49:01.294709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 319/651] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:01.352864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-811a91ec-c806-4df4-9173-9ce978962caf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:01.355121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-811a91ec-c806-4df4-9173-9ce978962caf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:01.361958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-811a91ec-c806-4df4-9173-9ce978962caf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.362449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-811a91ec-c806-4df4-9173-9ce978962caf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.362885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-811a91ec-c806-4df4-9173-9ce978962caf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.363586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-811a91ec-c806-4df4-9173-9ce978962caf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.364042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-811a91ec-c806-4df4-9173-9ce978962caf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.364497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-811a91ec-c806-4df4-9173-9ce978962caf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.397030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-811a91ec-c806-4df4-9173-9ce978962caf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048695 Aug 29 22:49:01.397531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 333/652] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:01.778592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:01.779231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:01.786192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.786669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.787095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.787777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.788265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.788680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.927470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:01.940770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7960fd58-4420-4eee-a814-32af2f6bc8e3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.165705 Aug 29 22:49:01.941669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 320/653] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:01 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:02.018104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:02.018617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:02.025289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.025498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.025838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.026561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.027549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.027970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.176793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:02.185882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c025ae34-29d5-4d1d-b76b-870beb8cf7d9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.171612 Aug 29 22:49:02.186474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 334/654] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:02 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:02.374788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:02.375770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:02.386096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.386585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.387014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.387719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.388205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.388624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.410360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e43d34d2-2b48-409f-af12-e439b8f0d3df tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:02.412541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e43d34d2-2b48-409f-af12-e439b8f0d3df tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:02.421246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e43d34d2-2b48-409f-af12-e439b8f0d3df tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.421728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e43d34d2-2b48-409f-af12-e439b8f0d3df tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.422163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e43d34d2-2b48-409f-af12-e439b8f0d3df tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.422883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e43d34d2-2b48-409f-af12-e439b8f0d3df tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.423317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e43d34d2-2b48-409f-af12-e439b8f0d3df tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.423739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e43d34d2-2b48-409f-af12-e439b8f0d3df tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.426484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:02.470557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e43d34d2-2b48-409f-af12-e439b8f0d3df tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063818 Aug 29 22:49:02.471532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 335/655] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:02.552849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:02.566130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a35c20d6-c033-470d-97d4-0226d9cda9f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.253178 Aug 29 22:49:02.566729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 321/656] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:02.964834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:02.965597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:02.972430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.972910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.973340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.974033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.974479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.974896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.116721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.125533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-674b7b4e-10a9-4985-900a-dce8d85bf66e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.165819 Aug 29 22:49:03.126151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 336/657] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:02 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:03.209271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:03.209838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:03.217457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.218000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.218467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.219193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.219681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.220147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.361271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.370226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6ab9c7ed-109c-490c-ba0d-c8e5e291262d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.165210 Aug 29 22:49:03.370820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 322/658] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:03 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:03.486269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5def0761-3536-47d8-8bea-15290e9118b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:03.488335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5def0761-3536-47d8-8bea-15290e9118b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:03.496172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5def0761-3536-47d8-8bea-15290e9118b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.496659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5def0761-3536-47d8-8bea-15290e9118b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.497092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5def0761-3536-47d8-8bea-15290e9118b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.497789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5def0761-3536-47d8-8bea-15290e9118b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.498244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5def0761-3536-47d8-8bea-15290e9118b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.498664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5def0761-3536-47d8-8bea-15290e9118b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.531177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5def0761-3536-47d8-8bea-15290e9118b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048985 Aug 29 22:49:03.531755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 337/659] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:03.596096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:03.596956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:03.604056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.604678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.605277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.606068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.606619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.607128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.757811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.767585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cb1fd1fc-af07-4abc-a471-419c5e72f643 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.175313 Aug 29 22:49:03.768260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 323/660] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:04.149037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:04.150005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:04.157472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.158115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.158657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.159582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.160265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.160791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.314419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:04.322959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1432e6f6-50c3-4c05-a366-19279981e8cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.178441 Aug 29 22:49:04.323543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 338/661] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:04 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:04.394009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:04.395037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:04.403622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.404208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.404742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.405545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.406086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.406622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.545282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-40582218-962b-4571-b49c-fe98ff654193 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:04.547934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-40582218-962b-4571-b49c-fe98ff654193 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:04.554170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:04.558458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40582218-962b-4571-b49c-fe98ff654193 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.559284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40582218-962b-4571-b49c-fe98ff654193 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.560002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40582218-962b-4571-b49c-fe98ff654193 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.561121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40582218-962b-4571-b49c-fe98ff654193 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.561696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40582218-962b-4571-b49c-fe98ff654193 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.562175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40582218-962b-4571-b49c-fe98ff654193 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.566279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-31ced621-34f5-4aeb-a166-485b3a95ca8f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.176641 Aug 29 22:49:04.567003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 324/662] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:04 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:04.597976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-40582218-962b-4571-b49c-fe98ff654193 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057534 Aug 29 22:49:04.598556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 339/663] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:04.790693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:04.791536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:04.799075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.799700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.800274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.801220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.801769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.802280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.959837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:04.969440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a04b48d7-a467-482a-822c-63eb70f9b91c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.182949 Aug 29 22:49:04.970033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 325/664] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:05.345491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:05.346088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:05.348973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=98 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:05.354290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.354854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.355291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.355989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.356589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.365770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.549254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:05.563984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4283d685-41ac-4527-875f-bfdd988c3c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.222010 Aug 29 22:49:05.565055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 340/665] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:05 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:05.596367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:05.597375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:05.609161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.610057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.611119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.611779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-32ed6721-547a-4b45-8af1-f3949d7dca6d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:05.612516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.613211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.613980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.614699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-32ed6721-547a-4b45-8af1-f3949d7dca6d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:05.622242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32ed6721-547a-4b45-8af1-f3949d7dca6d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.622731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32ed6721-547a-4b45-8af1-f3949d7dca6d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.623171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32ed6721-547a-4b45-8af1-f3949d7dca6d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.623896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32ed6721-547a-4b45-8af1-f3949d7dca6d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.624399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32ed6721-547a-4b45-8af1-f3949d7dca6d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.624817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32ed6721-547a-4b45-8af1-f3949d7dca6d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.684303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-32ed6721-547a-4b45-8af1-f3949d7dca6d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076852 Aug 29 22:49:05.685874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 341/666] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:05.817359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:05.825507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:05.834146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c9b6984b-9f51-42a2-9344-19d4d9de00b5 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.245226 Aug 29 22:49:05.835318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 326/667] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:05 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:05.993765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:05.994850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:06.001986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.002691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.003141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.003871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.004683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.005117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.192982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:06.203378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f014021a-1a7e-4408-8ab8-39a96643f582 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.214196 Aug 29 22:49:06.203983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 342/668] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:06.598070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:06.598847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:06.602063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:49:06.602938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 22:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff (ip 10.222.0.59) !!! Aug 29 22:49:06.612650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.613186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.613663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.614717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.615191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.615661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.699782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1716c821-cb71-47c5-9d8f-cfe6e6efdd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:06.702834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1716c821-cb71-47c5-9d8f-cfe6e6efdd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:06.710687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1716c821-cb71-47c5-9d8f-cfe6e6efdd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.711188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1716c821-cb71-47c5-9d8f-cfe6e6efdd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.711634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1716c821-cb71-47c5-9d8f-cfe6e6efdd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.712387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1716c821-cb71-47c5-9d8f-cfe6e6efdd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.712847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1716c821-cb71-47c5-9d8f-cfe6e6efdd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.713266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1716c821-cb71-47c5-9d8f-cfe6e6efdd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.754456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1716c821-cb71-47c5-9d8f-cfe6e6efdd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058837 Aug 29 22:49:06.755154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 343/669] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:06.804208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:06.818776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-006c92e7-c490-40a9-8411-4e053c0a42f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.224651 Aug 29 22:49:06.819168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 327/670] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:06 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:06.875008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:06.875779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:06.882223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.882774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.883422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.884351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.884806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.885227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.058192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:07.070587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f4c062f7-a715-4f17-b2e9-ea725f1a5e49 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.200576 Aug 29 22:49:07.072005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 344/671] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:06 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:07.238451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:07.238973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:07.246733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.253418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.253418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.253418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.253418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.254080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.463784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:07.473319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ecb088fe-4b2c-475f-8909-a0c5dc227467 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.238915 Aug 29 22:49:07.473924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 328/672] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:07.769041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-24a4cf55-3439-402c-8a43-2c2df8138b25 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:07.771195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-24a4cf55-3439-402c-8a43-2c2df8138b25 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:07.778512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a4cf55-3439-402c-8a43-2c2df8138b25 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.778996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a4cf55-3439-402c-8a43-2c2df8138b25 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.779429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a4cf55-3439-402c-8a43-2c2df8138b25 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.780168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a4cf55-3439-402c-8a43-2c2df8138b25 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.780629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a4cf55-3439-402c-8a43-2c2df8138b25 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.781053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a4cf55-3439-402c-8a43-2c2df8138b25 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.814727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-24a4cf55-3439-402c-8a43-2c2df8138b25 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049802 Aug 29 22:49:07.815329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 345/673] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:07.845234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:07.846554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:07.857019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.857505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.857936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.858637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.859151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.859574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.021094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:08.032721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4090ef34-5fe8-4c88-b12d-5141a2fcab50 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.193750 Aug 29 22:49:08.034006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 329/674] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:07 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:08.095897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:08.096540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:08.103525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.104058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.104769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.105984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.106504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.106979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.281988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:08.290098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ccab804f-2345-4ce1-b4c5-485f6cc662a1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.198153 Aug 29 22:49:08.290688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 346/675] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:08 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:08.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:08.496684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:08.503227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.503727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.504374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.504912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.505356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.505783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.676663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:08.687730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e6c34ab0-8305-43f8-9b2e-c9817b4e642c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1724 microversion: 2.1 time: 0.196457 Aug 29 22:49:08.688389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 330/676] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:08.830358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b297b1c3-c7dc-4f4b-bc77-0533e339391a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:08.832719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b297b1c3-c7dc-4f4b-bc77-0533e339391a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:08.841692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b297b1c3-c7dc-4f4b-bc77-0533e339391a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.842223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b297b1c3-c7dc-4f4b-bc77-0533e339391a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.842732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b297b1c3-c7dc-4f4b-bc77-0533e339391a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.843927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b297b1c3-c7dc-4f4b-bc77-0533e339391a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.844746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b297b1c3-c7dc-4f4b-bc77-0533e339391a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.845471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b297b1c3-c7dc-4f4b-bc77-0533e339391a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.896437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b297b1c3-c7dc-4f4b-bc77-0533e339391a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068818 Aug 29 22:49:08.897508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 347/677] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:09.073423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:09.074075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:09.081877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.082276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.082716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.083441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.083894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.084361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.239087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:09.248333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-74285c4a-84f9-4f0f-9f2e-cbe75452fbaf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.180164 Aug 29 22:49:09.248930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 331/678] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:09 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:09.313055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:09.313662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:09.319791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.321583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.322036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.322742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.323208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.323628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.500335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:09.512425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6749edd5-8210-425b-96f2-3138d4c6a9b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.202912 Aug 29 22:49:09.523986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 348/679] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:09 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:09.712206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:09.712824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:09.719344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.719831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.720297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.721006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.721476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.721879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.930658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:09.934257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f144c537-8a9d-45a7-98b6-04b2e4d17f58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:09.938003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f144c537-8a9d-45a7-98b6-04b2e4d17f58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:09.941633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-250d21a1-5d83-489e-8901-3e755c8f11d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1730 microversion: 2.1 time: 0.233566 Aug 29 22:49:09.942599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 332/680] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:09.949636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f144c537-8a9d-45a7-98b6-04b2e4d17f58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.950458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f144c537-8a9d-45a7-98b6-04b2e4d17f58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.951195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f144c537-8a9d-45a7-98b6-04b2e4d17f58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.952453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f144c537-8a9d-45a7-98b6-04b2e4d17f58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.953231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f144c537-8a9d-45a7-98b6-04b2e4d17f58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.953953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f144c537-8a9d-45a7-98b6-04b2e4d17f58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.965453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f2a1cdd9-6e53-48df-b871-ec09f845792e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:09.965952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f2a1cdd9-6e53-48df-b871-ec09f845792e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:09.972323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2a1cdd9-6e53-48df-b871-ec09f845792e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.972816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2a1cdd9-6e53-48df-b871-ec09f845792e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.973243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2a1cdd9-6e53-48df-b871-ec09f845792e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.973940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2a1cdd9-6e53-48df-b871-ec09f845792e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.974394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2a1cdd9-6e53-48df-b871-ec09f845792e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.974811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2a1cdd9-6e53-48df-b871-ec09f845792e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.007018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f144c537-8a9d-45a7-98b6-04b2e4d17f58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098897 Aug 29 22:49:10.008050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 349/681] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:10.080422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f2a1cdd9-6e53-48df-b871-ec09f845792e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110166 Aug 29 22:49:10.080422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 333/682] 10.222.0.59 () {58 vars in 1275 bytes} [Mon Aug 29 22:49:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:10.285215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:10.285922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:10.293123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.293615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.294047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.294754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.295206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.295659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.540267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:10.540818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:10.547058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.547633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.548063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.548872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.550065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.550065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.553717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:10.564047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d750c470-feb0-4539-9424-6d3e5afdb210 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.282638 Aug 29 22:49:10.565077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 350/683] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:10 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:10.714642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:10.724539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef7aaf0a-6679-42b8-a397-22ca7830e9f2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.188902 Aug 29 22:49:10.725235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 334/684] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:10 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:11.022076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b2a7ad43-bf63-4c05-bf85-8dd77239fa7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:11.025545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b2a7ad43-bf63-4c05-bf85-8dd77239fa7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:11.033820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a7ad43-bf63-4c05-bf85-8dd77239fa7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.034319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a7ad43-bf63-4c05-bf85-8dd77239fa7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.034760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a7ad43-bf63-4c05-bf85-8dd77239fa7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.035500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a7ad43-bf63-4c05-bf85-8dd77239fa7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.036020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a7ad43-bf63-4c05-bf85-8dd77239fa7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.036510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a7ad43-bf63-4c05-bf85-8dd77239fa7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.067108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:11.074379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b2a7ad43-bf63-4c05-bf85-8dd77239fa7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057760 Aug 29 22:49:11.074982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 351/685] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:11.278879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-8a141d35-bd62-47d6-9004-86c27c113ca6 req-90542365-f2a2-4b68-811f-8e54aaa6b1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a903cf9-0a2d-4391-ad67-ae87403930d7", "tag": "7f847326-2f84-445f-8fd3-98855eb599bf"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:11.289147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-8a141d35-bd62-47d6-9004-86c27c113ca6 req-90542365-f2a2-4b68-811f-8e54aaa6b1c9 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.290151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-8a141d35-bd62-47d6-9004-86c27c113ca6 req-90542365-f2a2-4b68-811f-8e54aaa6b1c9 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.290885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-8a141d35-bd62-47d6-9004-86c27c113ca6 req-90542365-f2a2-4b68-811f-8e54aaa6b1c9 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.305793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-8a141d35-bd62-47d6-9004-86c27c113ca6 req-90542365-f2a2-4b68-811f-8e54aaa6b1c9 service nova] Creating event network-changed:7f847326-2f84-445f-8fd3-98855eb599bf for instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 on hv-cinder-85426 Aug 29 22:49:11.318832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-8a141d35-bd62-47d6-9004-86c27c113ca6 req-90542365-f2a2-4b68-811f-8e54aaa6b1c9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038699 Aug 29 22:49:11.320039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 335/686] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:11.587877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:11.588111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:11.594265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:11.594979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:11.596429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.597251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.598003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.598940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.599607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.600518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.604496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.605214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.605727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.606750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.607223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.608163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.714602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lazy-loading 'services' on Instance uuid 0a903cf9-0a2d-4391-ad67-ae87403930d7 {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:11.779309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:11.787529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-71fa05b6-04c7-47eb-8bb1-54112b417bc9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.200389 Aug 29 22:49:11.792706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 336/687] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:11 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:11.793830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:11.794444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:11.800882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.801705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.802139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.802844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.803266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.803683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.943130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-deaf956b-2bc1-4261-83b5-2b2e579ec681 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments/ab742603-e3e4-4f53-a40e-07794971b6aa" status: 202 len: 0 microversion: 2.1 time: 0.360268 Aug 29 22:49:11.948023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 352/688] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:49:11 2022] DELETE /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments/ab742603-e3e4-4f53-a40e-07794971b6aa => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:49:11.953577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3cadca3e-1927-46fc-be7d-a5255c9d8cfe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:11.955835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3cadca3e-1927-46fc-be7d-a5255c9d8cfe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:11.963618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cadca3e-1927-46fc-be7d-a5255c9d8cfe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.964110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cadca3e-1927-46fc-be7d-a5255c9d8cfe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.964581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cadca3e-1927-46fc-be7d-a5255c9d8cfe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.965316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cadca3e-1927-46fc-be7d-a5255c9d8cfe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.965719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:11.967464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cadca3e-1927-46fc-be7d-a5255c9d8cfe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.967464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cadca3e-1927-46fc-be7d-a5255c9d8cfe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.974603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d2d6d1ea-22ac-4da2-a365-b1dd4e8e57a2 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.185422 Aug 29 22:49:11.975465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 337/689] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:11 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:12.004398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3cadca3e-1927-46fc-be7d-a5255c9d8cfe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055058 Aug 29 22:49:12.009968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 353/690] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:12.087197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7207a1ac-9485-43e5-bca5-00a9b2a98e81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:12.089663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7207a1ac-9485-43e5-bca5-00a9b2a98e81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:12.096526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7207a1ac-9485-43e5-bca5-00a9b2a98e81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:12.097019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7207a1ac-9485-43e5-bca5-00a9b2a98e81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:12.097536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7207a1ac-9485-43e5-bca5-00a9b2a98e81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.098363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7207a1ac-9485-43e5-bca5-00a9b2a98e81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:12.098914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7207a1ac-9485-43e5-bca5-00a9b2a98e81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:12.099441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7207a1ac-9485-43e5-bca5-00a9b2a98e81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.132228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7207a1ac-9485-43e5-bca5-00a9b2a98e81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049002 Aug 29 22:49:12.133898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 338/691] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:12.812601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:12.813238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:12.820185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:12.820957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:12.821401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.822105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:12.822566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:12.822992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.977384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:12.985589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4164044a-92fe-45cc-858d-24d2f1759512 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.177008 Aug 29 22:49:12.993180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 354/692] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:12 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:12.997944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:12.998538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:13.007771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.008354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.008929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.009880 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.010348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.010792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.018337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8f262229-4157-44f9-8208-ea4d312d0e3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:13.020952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8f262229-4157-44f9-8208-ea4d312d0e3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:13.029369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f262229-4157-44f9-8208-ea4d312d0e3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.029878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f262229-4157-44f9-8208-ea4d312d0e3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.030312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f262229-4157-44f9-8208-ea4d312d0e3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.031116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f262229-4157-44f9-8208-ea4d312d0e3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.031593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f262229-4157-44f9-8208-ea4d312d0e3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.032022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f262229-4157-44f9-8208-ea4d312d0e3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.074506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8f262229-4157-44f9-8208-ea4d312d0e3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059995 Aug 29 22:49:13.075523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 355/693] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:13.145761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5bf47df9-0847-44f8-b306-612bf1c8e1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:13.148235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5bf47df9-0847-44f8-b306-612bf1c8e1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:13.155715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bf47df9-0847-44f8-b306-612bf1c8e1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.156237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bf47df9-0847-44f8-b306-612bf1c8e1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.156677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bf47df9-0847-44f8-b306-612bf1c8e1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.157389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bf47df9-0847-44f8-b306-612bf1c8e1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.157843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bf47df9-0847-44f8-b306-612bf1c8e1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.158266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bf47df9-0847-44f8-b306-612bf1c8e1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.166921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:13.174918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aca4a058-decb-4693-92fd-e03b921047f9 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.181517 Aug 29 22:49:13.175505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 339/694] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:12 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:13.192459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5bf47df9-0847-44f8-b306-612bf1c8e1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050742 Aug 29 22:49:13.193048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 356/695] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:13.337711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-19fec3b7-b069-4c0c-baf6-7aca5c2fa887 req-c698bb72-7e34-480b-8957-c0c0012f2a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a903cf9-0a2d-4391-ad67-ae87403930d7", "tag": "7f847326-2f84-445f-8fd3-98855eb599bf"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:13.348180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-19fec3b7-b069-4c0c-baf6-7aca5c2fa887 req-c698bb72-7e34-480b-8957-c0c0012f2a6d service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.350751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-19fec3b7-b069-4c0c-baf6-7aca5c2fa887 req-c698bb72-7e34-480b-8957-c0c0012f2a6d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.350751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-19fec3b7-b069-4c0c-baf6-7aca5c2fa887 req-c698bb72-7e34-480b-8957-c0c0012f2a6d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.362200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-19fec3b7-b069-4c0c-baf6-7aca5c2fa887 req-c698bb72-7e34-480b-8957-c0c0012f2a6d service nova] Creating event network-changed:7f847326-2f84-445f-8fd3-98855eb599bf for instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 on hv-cinder-85426 Aug 29 22:49:13.367812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-19fec3b7-b069-4c0c-baf6-7aca5c2fa887 req-c698bb72-7e34-480b-8957-c0c0012f2a6d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034268 Aug 29 22:49:13.368651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 340/696] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:14.010223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:14.011535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:14.020201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.020673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.021298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.022040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.022500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.022920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.088410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7cf5e0bd-965c-45c1-826a-7cb6f7eb9686 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:14.090733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7cf5e0bd-965c-45c1-826a-7cb6f7eb9686 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:14.098281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cf5e0bd-965c-45c1-826a-7cb6f7eb9686 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.099136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cf5e0bd-965c-45c1-826a-7cb6f7eb9686 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.099761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cf5e0bd-965c-45c1-826a-7cb6f7eb9686 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.100736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cf5e0bd-965c-45c1-826a-7cb6f7eb9686 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.101915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cf5e0bd-965c-45c1-826a-7cb6f7eb9686 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.102528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cf5e0bd-965c-45c1-826a-7cb6f7eb9686 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.141906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7cf5e0bd-965c-45c1-826a-7cb6f7eb9686 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057845 Aug 29 22:49:14.142749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 341/697] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:14.201418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:14.201418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:14.208207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.208852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.209393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.210208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.211511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.212391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.445333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:14.454461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e5b81106-1289-494e-92ae-c123568e44d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1682 microversion: 2.1 time: 0.450080 Aug 29 22:49:14.455178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 357/698] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:14 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1682 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:14.461467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f18b8836-e47f-42ec-9645-3a6a94e01a84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:14.464271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f18b8836-e47f-42ec-9645-3a6a94e01a84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:14.475674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f18b8836-e47f-42ec-9645-3a6a94e01a84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.477925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f18b8836-e47f-42ec-9645-3a6a94e01a84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.478758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f18b8836-e47f-42ec-9645-3a6a94e01a84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.481110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f18b8836-e47f-42ec-9645-3a6a94e01a84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.481745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f18b8836-e47f-42ec-9645-3a6a94e01a84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.482336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f18b8836-e47f-42ec-9645-3a6a94e01a84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.521447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f18b8836-e47f-42ec-9645-3a6a94e01a84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064974 Aug 29 22:49:14.522207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 358/699] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:14.739860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:14.749382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-58bc6c70-1c9e-4476-86d1-d2e2c61dbc03 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1675 microversion: 2.1 time: 0.555342 Aug 29 22:49:14.750334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 342/700] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:14 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1675 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:15.162689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6c511b17-63e1-4205-baa7-44844192ec17 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:15.167483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6c511b17-63e1-4205-baa7-44844192ec17 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:15.183534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c511b17-63e1-4205-baa7-44844192ec17 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.184722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c511b17-63e1-4205-baa7-44844192ec17 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.185773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c511b17-63e1-4205-baa7-44844192ec17 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.188014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c511b17-63e1-4205-baa7-44844192ec17 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.189121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c511b17-63e1-4205-baa7-44844192ec17 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.190109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c511b17-63e1-4205-baa7-44844192ec17 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.241746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6c511b17-63e1-4205-baa7-44844192ec17 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086886 Aug 29 22:49:15.243321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 359/701] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:15.446532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-85ab2f48-f9bb-49fc-8c1e-f408d8145322 req-b58a5f44-476f-47df-ab47-9de144c17472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f93cf86-a1d6-46b8-8b19-07daf0b193ff", "name": "network-vif-deleted", "tag": "760fa8c7-78ec-4520-a365-80d33ec202a6"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:15.472434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-85ab2f48-f9bb-49fc-8c1e-f408d8145322 req-b58a5f44-476f-47df-ab47-9de144c17472 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.473299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-85ab2f48-f9bb-49fc-8c1e-f408d8145322 req-b58a5f44-476f-47df-ab47-9de144c17472 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.474070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-85ab2f48-f9bb-49fc-8c1e-f408d8145322 req-b58a5f44-476f-47df-ab47-9de144c17472 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.485004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:15.485612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:15.496690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.511725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.511725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.511725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.511725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.512245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.512336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-85ab2f48-f9bb-49fc-8c1e-f408d8145322 req-b58a5f44-476f-47df-ab47-9de144c17472 service nova] Creating event network-vif-deleted:760fa8c7-78ec-4520-a365-80d33ec202a6 for instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff on hv-cinder-85426 Aug 29 22:49:15.527443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-85ab2f48-f9bb-49fc-8c1e-f408d8145322 req-b58a5f44-476f-47df-ab47-9de144c17472 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087487 Aug 29 22:49:15.529328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 343/702] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:15.550010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-adba790f-729c-469a-8e9f-967dc55b06a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:15.557352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-adba790f-729c-469a-8e9f-967dc55b06a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:15.569123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adba790f-729c-469a-8e9f-967dc55b06a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.569621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adba790f-729c-469a-8e9f-967dc55b06a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.570124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adba790f-729c-469a-8e9f-967dc55b06a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.571647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adba790f-729c-469a-8e9f-967dc55b06a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.571810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adba790f-729c-469a-8e9f-967dc55b06a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.572127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adba790f-729c-469a-8e9f-967dc55b06a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.626678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:15.641424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-741421aa-77a2-4ab9-b5b3-d1c898bf42c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1614 microversion: 2.1 time: 0.157177 Aug 29 22:49:15.641424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 360/703] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:15 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1614 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:15.662300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-adba790f-729c-469a-8e9f-967dc55b06a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127400 Aug 29 22:49:15.682144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 344/704] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:15.777557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:15.778905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:15.785631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-2d1bb677-94bc-48a7-95b4-c32f643f12c2 req-45ebc358-f2fa-48c1-912b-4ef357a4a70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82aaeac-b1e6-4be1-a5a5-0605c648b05c", "name": "network-vif-deleted", "tag": "cc84dffa-2136-4ffc-be74-eb8d23cea473"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:15.791002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.792208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.799739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.800446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.801367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.806393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.814817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-2d1bb677-94bc-48a7-95b4-c32f643f12c2 req-45ebc358-f2fa-48c1-912b-4ef357a4a70a service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.815178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-2d1bb677-94bc-48a7-95b4-c32f643f12c2 req-45ebc358-f2fa-48c1-912b-4ef357a4a70a service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.815613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-2d1bb677-94bc-48a7-95b4-c32f643f12c2 req-45ebc358-f2fa-48c1-912b-4ef357a4a70a service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.842729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-2d1bb677-94bc-48a7-95b4-c32f643f12c2 req-45ebc358-f2fa-48c1-912b-4ef357a4a70a service nova] Creating event network-vif-deleted:cc84dffa-2136-4ffc-be74-eb8d23cea473 for instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c on hv-cinder-85426 Aug 29 22:49:15.850819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-2d1bb677-94bc-48a7-95b4-c32f643f12c2 req-45ebc358-f2fa-48c1-912b-4ef357a4a70a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068926 Aug 29 22:49:15.853186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 345/705] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:15.951785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:15.960992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4b1520ff-26b4-4021-9a54-98eb70e41f99 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1607 microversion: 2.1 time: 0.188311 Aug 29 22:49:15.962045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 361/706] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:15 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1607 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:16.255721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a7019534-81a7-4c50-b1fa-1da605dac4af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:16.259101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a7019534-81a7-4c50-b1fa-1da605dac4af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:16.266075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7019534-81a7-4c50-b1fa-1da605dac4af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.266775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7019534-81a7-4c50-b1fa-1da605dac4af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.267580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7019534-81a7-4c50-b1fa-1da605dac4af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.268657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7019534-81a7-4c50-b1fa-1da605dac4af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.269272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7019534-81a7-4c50-b1fa-1da605dac4af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.269849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7019534-81a7-4c50-b1fa-1da605dac4af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.297131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:16.310453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a7019534-81a7-4c50-b1fa-1da605dac4af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059040 Aug 29 22:49:16.311291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 346/707] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:16.665796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:16.666824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:16.674170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.674965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.675507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.676627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.677204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.677728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.699475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-90f16b66-eed9-4593-b4b7-45aeb6bc08a0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:16.717631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-90f16b66-eed9-4593-b4b7-45aeb6bc08a0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:16.719622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.720123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.720592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.721056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lazy-loading 'fault' on Instance uuid 3f93cf86-a1d6-46b8-8b19-07daf0b193ff {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:16.740752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90f16b66-eed9-4593-b4b7-45aeb6bc08a0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.741162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90f16b66-eed9-4593-b4b7-45aeb6bc08a0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.741599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90f16b66-eed9-4593-b4b7-45aeb6bc08a0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.742993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90f16b66-eed9-4593-b4b7-45aeb6bc08a0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.743504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90f16b66-eed9-4593-b4b7-45aeb6bc08a0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.744095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90f16b66-eed9-4593-b4b7-45aeb6bc08a0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.774219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:16.793942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b3430f85-ac18-461f-b291-6dda961ccc89 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1332 microversion: 2.1 time: 0.133422 Aug 29 22:49:16.800080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 362/708] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:16 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:16.802387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-90f16b66-eed9-4593-b4b7-45aeb6bc08a0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102012 Aug 29 22:49:16.809507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 347/709] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:16.986549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:16.987518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:16.994977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.995469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.995977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.996822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.997413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.998039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.037301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.037908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.038440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.040247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lazy-loading 'fault' on Instance uuid b82aaeac-b1e6-4be1-a5a5-0605c648b05c {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:17.095461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:17.104692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-746f1415-27a5-4788-80ef-843335f121ec tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 200 len: 1327 microversion: 2.1 time: 0.121889 Aug 29 22:49:17.119580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 363/710] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:16 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:17.323194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b5e8e14e-b210-479b-adf2-797df89a0fc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:17.325519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b5e8e14e-b210-479b-adf2-797df89a0fc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:17.332434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5e8e14e-b210-479b-adf2-797df89a0fc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.332924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5e8e14e-b210-479b-adf2-797df89a0fc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.337374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5e8e14e-b210-479b-adf2-797df89a0fc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.337374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5e8e14e-b210-479b-adf2-797df89a0fc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.337374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5e8e14e-b210-479b-adf2-797df89a0fc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.337374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5e8e14e-b210-479b-adf2-797df89a0fc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.369804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b5e8e14e-b210-479b-adf2-797df89a0fc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050838 Aug 29 22:49:17.370408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 348/711] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:17.816957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d9e56c9a-fdb3-4bd5-965d-4e04d9567e1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:17.819006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d9e56c9a-fdb3-4bd5-965d-4e04d9567e1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:17.821939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:17.822552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:17.826393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9e56c9a-fdb3-4bd5-965d-4e04d9567e1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.826879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9e56c9a-fdb3-4bd5-965d-4e04d9567e1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.827315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9e56c9a-fdb3-4bd5-965d-4e04d9567e1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.828019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9e56c9a-fdb3-4bd5-965d-4e04d9567e1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.828513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9e56c9a-fdb3-4bd5-965d-4e04d9567e1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.828938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9e56c9a-fdb3-4bd5-965d-4e04d9567e1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.829089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.829578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.830017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.830714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.831423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.831846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.861130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d9e56c9a-fdb3-4bd5-965d-4e04d9567e1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048175 Aug 29 22:49:17.861707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 364/712] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:17.865198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.865677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.866181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.866632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lazy-loading 'fault' on Instance uuid 3f93cf86-a1d6-46b8-8b19-07daf0b193ff {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:17.912740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:17.920966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aa072850-5540-47e6-b082-ee85fd0a57da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 200 len: 1332 microversion: 2.1 time: 0.103401 Aug 29 22:49:17.921555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 349/713] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:17 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:18.127265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:18.127913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:18.135721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.136248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.136963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.137740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.138195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.139542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.157660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] HTTP exception thrown: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Request method failure captured: Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c HTTP/1.1 Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEuuOn3fAMm-vmkfkzgy3YqCQiJSnWcAQ32q5zqpLHxaYYBd5Pnw3CWZTh9sU8mZ0Xq2svzUF921MogkriqHtKTylN0iZrPnpWanq3EHkTNtOYYe96baQ5L80gFKXUb8NsN7wPFJ8z9aSZE0U63hawbzOCRdPr5RjUlJQfnal2FyL0 Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:49:18.159740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df7ab727f89e4fcb9933c2098b4fb501", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeTestJSON-127938805 Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeTestJSON-127938805-project Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 43cdaa09925c4b00be3b45cea4fd40b7 Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeTestJSON-127938805-project Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 22:49:18.166849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': 'b82aaeac-b1e6-4be1-a5a5-0605c648b05c'} Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:49:18.167730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 22:49:18.169263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.170561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Returning 404 to user: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:49:18.170561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-65338a10-c433-445c-97a3-effa51795312 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 404 len: 111 microversion: 2.1 time: 0.037993 Aug 29 22:49:18.170561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 365/714] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:18 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:49:18.171558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e1a5a5d4-5458-4d49-a08d-8f4b8beceb4a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '.version_select at 0x7febd5146af0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:18.264839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e1a5a5d4-5458-4d49-a08d-8f4b8beceb4a tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327097771" status: 202 len: 0 microversion: 2.1 time: 0.097257 Aug 29 22:49:18.265755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 350/715] 10.222.0.59 () {58 vars in 1218 bytes} [Mon Aug 29 22:49:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327097771 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:49:18.384048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-45f77fb1-0220-4061-96a5-5c6055883a37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:18.386589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-45f77fb1-0220-4061-96a5-5c6055883a37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:18.392861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45f77fb1-0220-4061-96a5-5c6055883a37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.393355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45f77fb1-0220-4061-96a5-5c6055883a37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.393791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45f77fb1-0220-4061-96a5-5c6055883a37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.394502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45f77fb1-0220-4061-96a5-5c6055883a37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.394968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45f77fb1-0220-4061-96a5-5c6055883a37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.395401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45f77fb1-0220-4061-96a5-5c6055883a37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.427868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-45f77fb1-0220-4061-96a5-5c6055883a37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048393 Aug 29 22:49:18.432980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 366/716] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:18.874642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fe68ebdf-ccb8-4ed7-8c0b-fd3954e681a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:18.876794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fe68ebdf-ccb8-4ed7-8c0b-fd3954e681a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:18.884170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fe68ebdf-ccb8-4ed7-8c0b-fd3954e681a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.884671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fe68ebdf-ccb8-4ed7-8c0b-fd3954e681a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.885103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fe68ebdf-ccb8-4ed7-8c0b-fd3954e681a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.885800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fe68ebdf-ccb8-4ed7-8c0b-fd3954e681a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.886253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fe68ebdf-ccb8-4ed7-8c0b-fd3954e681a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.886674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fe68ebdf-ccb8-4ed7-8c0b-fd3954e681a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.920461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fe68ebdf-ccb8-4ed7-8c0b-fd3954e681a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050334 Aug 29 22:49:18.921279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 351/717] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:18.942919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:18.943625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:18.953051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.953540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.953984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.954678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:18.955126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:18.955577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff HTTP/1.1 Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:49:18.974124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 22:49:18.975809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '3f93cf86-a1d6-46b8-8b19-07daf0b193ff'} Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:49:18.977295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 22:49:18.981121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:49:18.983003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:49:18.983003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4b144e50-c6fb-4e9a-93b3-eae98e31f1cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 404 len: 111 microversion: 2.1 time: 0.036401 Aug 29 22:49:18.983003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 367/718] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:18 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:49:18.985040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b351e682-9da2-4840-a81f-c29b74fc4f63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '.version_select at 0x7febd4fd3af0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:19.074911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2aa7d4e7-9d99-4b58-9629-2aea69119d65 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Action: 'create', calling method: .version_select at 0x7febd50b6790>, body: {"keypair": {"name": "tempest-keypair-645226916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxvuGsn0fHQBl7fGYBR1JjNRY9xMci8tBYj29gIxz5S9SiM9HtTNJr0Iu36/1/E7hDJvxKiGDdzbFWg47mkbqUfuRizlMXeG+HXkNNUL6cyyeI4uxNqJCzdZ1TBLg3NBw=="}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:19.091705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-2aa7d4e7-9d99-4b58-9629-2aea69119d65 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Getting quotas for project df7ab727f89e4fcb9933c2098b4fb501. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:49:19.092311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b351e682-9da2-4840-a81f-c29b74fc4f63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725617119" status: 202 len: 0 microversion: 2.1 time: 0.111087 Aug 29 22:49:19.096317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 352/719] 10.222.0.59 () {58 vars in 1221 bytes} [Mon Aug 29 22:49:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725617119 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:49:19.097015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-2aa7d4e7-9d99-4b58-9629-2aea69119d65 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Getting quotas for user 43cdaa09925c4b00be3b45cea4fd40b7 and project df7ab727f89e4fcb9933c2098b4fb501. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:49:19.214231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2aa7d4e7-9d99-4b58-9629-2aea69119d65 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143194 Aug 29 22:49:19.214923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 368/720] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 22:49:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:19.441550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c15b91f8-d875-4bab-9e39-dbe448e32f85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:19.443829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c15b91f8-d875-4bab-9e39-dbe448e32f85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:19.451584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c15b91f8-d875-4bab-9e39-dbe448e32f85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.452269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c15b91f8-d875-4bab-9e39-dbe448e32f85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.452960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c15b91f8-d875-4bab-9e39-dbe448e32f85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.453875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c15b91f8-d875-4bab-9e39-dbe448e32f85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.454368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c15b91f8-d875-4bab-9e39-dbe448e32f85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.455021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c15b91f8-d875-4bab-9e39-dbe448e32f85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.489362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c15b91f8-d875-4bab-9e39-dbe448e32f85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051846 Aug 29 22:49:19.489947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 353/721] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:19.936285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-84b45674-db17-4cd5-bd84-6b2ed9a69c95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:19.939209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-84b45674-db17-4cd5-bd84-6b2ed9a69c95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:19.954453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b45674-db17-4cd5-bd84-6b2ed9a69c95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.954453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b45674-db17-4cd5-bd84-6b2ed9a69c95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.954453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b45674-db17-4cd5-bd84-6b2ed9a69c95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.954453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b45674-db17-4cd5-bd84-6b2ed9a69c95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.955556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b45674-db17-4cd5-bd84-6b2ed9a69c95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.955556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b45674-db17-4cd5-bd84-6b2ed9a69c95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.961462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:19.962381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:19.967621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:19.969324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.969825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.976738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.976738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.976738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.976738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.985112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-84b45674-db17-4cd5-bd84-6b2ed9a69c95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055683 Aug 29 22:49:19.985682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 369/722] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:20.027259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:20.028971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:20.036168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.036692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.037145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.038260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.039391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.040055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.062159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lazy-loading 'services' on Instance uuid 50bc49c0-59c8-4adc-9c9a-a43adb38c922 {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:20.067056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:49:20.342974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a244dc71-55ba-47cb-9e22-a978ef2dca95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments/f953de72-ac45-4cab-aa04-011d126c2934" status: 202 len: 0 microversion: 2.1 time: 0.385292 Aug 29 22:49:20.343850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 354/723] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:49:19 2022] DELETE /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments/f953de72-ac45-4cab-aa04-011d126c2934 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:49:20.357416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-47fe230d-72eb-4339-bf81-c62e3e3dd7b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:20.359962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-47fe230d-72eb-4339-bf81-c62e3e3dd7b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:20.366906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47fe230d-72eb-4339-bf81-c62e3e3dd7b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.367376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47fe230d-72eb-4339-bf81-c62e3e3dd7b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.367998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47fe230d-72eb-4339-bf81-c62e3e3dd7b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.368751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47fe230d-72eb-4339-bf81-c62e3e3dd7b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.369209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47fe230d-72eb-4339-bf81-c62e3e3dd7b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.369628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47fe230d-72eb-4339-bf81-c62e3e3dd7b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.405158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-47fe230d-72eb-4339-bf81-c62e3e3dd7b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054155 Aug 29 22:49:20.405781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 355/724] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:20.501989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3e58bcba-8f33-4b2a-887b-eff2ecfccbc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:20.504127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3e58bcba-8f33-4b2a-887b-eff2ecfccbc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:20.510200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e58bcba-8f33-4b2a-887b-eff2ecfccbc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.510824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e58bcba-8f33-4b2a-887b-eff2ecfccbc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.511260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e58bcba-8f33-4b2a-887b-eff2ecfccbc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.511948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e58bcba-8f33-4b2a-887b-eff2ecfccbc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.512424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e58bcba-8f33-4b2a-887b-eff2ecfccbc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.512845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e58bcba-8f33-4b2a-887b-eff2ecfccbc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.542655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e7b4a166-c843-435b-a580-5891e13b2f44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 204 len: 0 microversion: 2.1 time: 0.519741 Aug 29 22:49:20.543347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 370/725] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 22:49:20 2022] DELETE /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:49:20.544600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3e58bcba-8f33-4b2a-887b-eff2ecfccbc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Aug 29 22:49:20.545453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 356/726] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:20.552770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:20.553479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:20.559833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.560373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.561019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.561727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.562199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.562658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.702332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:20.714710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-29ed00e2-26da-4301-8260-d006da5bf778 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1576 microversion: 2.1 time: 0.165984 Aug 29 22:49:20.715672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 371/727] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:20 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:20.997769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3231b678-b7c5-4a07-831a-90e2df772438 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:21.000190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3231b678-b7c5-4a07-831a-90e2df772438 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:21.006999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3231b678-b7c5-4a07-831a-90e2df772438 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.008124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3231b678-b7c5-4a07-831a-90e2df772438 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.008611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3231b678-b7c5-4a07-831a-90e2df772438 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.009321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3231b678-b7c5-4a07-831a-90e2df772438 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.009846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3231b678-b7c5-4a07-831a-90e2df772438 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.010318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3231b678-b7c5-4a07-831a-90e2df772438 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.043438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3231b678-b7c5-4a07-831a-90e2df772438 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049682 Aug 29 22:49:21.044015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 357/728] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:21.418847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a9352218-f95e-424d-86cb-4f0642d51b25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:21.421249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a9352218-f95e-424d-86cb-4f0642d51b25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:21.428071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9352218-f95e-424d-86cb-4f0642d51b25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.428591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9352218-f95e-424d-86cb-4f0642d51b25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.429924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9352218-f95e-424d-86cb-4f0642d51b25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.430588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9352218-f95e-424d-86cb-4f0642d51b25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.431284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9352218-f95e-424d-86cb-4f0642d51b25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.432079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9352218-f95e-424d-86cb-4f0642d51b25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.467290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a9352218-f95e-424d-86cb-4f0642d51b25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053248 Aug 29 22:49:21.468239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 372/729] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:21 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:21.558244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e0bbf918-268e-45bb-a587-d5f1f6ae4c81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:21.560565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e0bbf918-268e-45bb-a587-d5f1f6ae4c81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:21.566875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0bbf918-268e-45bb-a587-d5f1f6ae4c81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.567372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0bbf918-268e-45bb-a587-d5f1f6ae4c81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.567808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0bbf918-268e-45bb-a587-d5f1f6ae4c81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.568548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0bbf918-268e-45bb-a587-d5f1f6ae4c81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.569011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0bbf918-268e-45bb-a587-d5f1f6ae4c81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.569453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0bbf918-268e-45bb-a587-d5f1f6ae4c81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.588336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-257206947", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e68f004d-6141-4239-8019-0a6bfb114017"}], "security_groups": [{"name": "tempest-securitygroup--960679042"}], "key_name": "tempest-keypair-645226916", "user_data": "}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:21.608066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e0bbf918-268e-45bb-a587-d5f1f6ae4c81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054703 Aug 29 22:49:21.609990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 358/730] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:21.700910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] validate_networks() for [('e68f004d-6141-4239-8019-0a6bfb114017', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:49:21.742920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:21.743784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:21.750384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.750873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.751306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.751997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.752512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.752931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.900326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:21.909309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-603fdfec-ecfb-4d1f-8547-7a6cb3567077 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1576 microversion: 2.1 time: 0.170860 Aug 29 22:49:21.909597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 359/731] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:21 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:22.057325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c366ca5e-d576-49f8-9b9f-16ce6cc0b26d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:22.060001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c366ca5e-d576-49f8-9b9f-16ce6cc0b26d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:22.067040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c366ca5e-d576-49f8-9b9f-16ce6cc0b26d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.067683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c366ca5e-d576-49f8-9b9f-16ce6cc0b26d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.068285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c366ca5e-d576-49f8-9b9f-16ce6cc0b26d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.069083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c366ca5e-d576-49f8-9b9f-16ce6cc0b26d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.069544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c366ca5e-d576-49f8-9b9f-16ce6cc0b26d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.069997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c366ca5e-d576-49f8-9b9f-16ce6cc0b26d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.104639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c366ca5e-d576-49f8-9b9f-16ce6cc0b26d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052707 Aug 29 22:49:22.105381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 360/732] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:22.168478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:49:22.168801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:49:22.169300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:49:22.169712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:49:22.170192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:49:22.179629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.180102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.180573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.181345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.181803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.182229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.206874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Getting quotas for project df7ab727f89e4fcb9933c2098b4fb501. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:49:22.212237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Getting quotas for user 43cdaa09925c4b00be3b45cea4fd40b7 and project df7ab727f89e4fcb9933c2098b4fb501. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:49:22.224041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:49:22.226453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:49:22.236742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:22.351283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8830681f-2ab4-4011-914a-58ecbe048f41 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.770614 Aug 29 22:49:22.352389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 373/733] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 22:49:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:49:22.365775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6e016305-8c12-4fc0-9bda-d7ab96dc7b60 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:22.366395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6e016305-8c12-4fc0-9bda-d7ab96dc7b60 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:22.443134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6e016305-8c12-4fc0-9bda-d7ab96dc7b60 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:22.451730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6e016305-8c12-4fc0-9bda-d7ab96dc7b60 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1236 microversion: 2.1 time: 0.090236 Aug 29 22:49:22.468477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 361/734] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:22 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:22.481330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-356fdea1-ef18-4a14-8953-f8d207c6dff5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:22.484385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-356fdea1-ef18-4a14-8953-f8d207c6dff5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:22.495668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-356fdea1-ef18-4a14-8953-f8d207c6dff5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.495668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-356fdea1-ef18-4a14-8953-f8d207c6dff5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.495668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-356fdea1-ef18-4a14-8953-f8d207c6dff5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.495668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-356fdea1-ef18-4a14-8953-f8d207c6dff5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.496205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-356fdea1-ef18-4a14-8953-f8d207c6dff5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.496205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-356fdea1-ef18-4a14-8953-f8d207c6dff5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.536905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-356fdea1-ef18-4a14-8953-f8d207c6dff5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061743 Aug 29 22:49:22.537818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 374/735] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:22.628421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-79bb3fd7-25b8-4200-8a5c-0c03215b2551 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:22.631163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-79bb3fd7-25b8-4200-8a5c-0c03215b2551 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:22.639448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79bb3fd7-25b8-4200-8a5c-0c03215b2551 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.641564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79bb3fd7-25b8-4200-8a5c-0c03215b2551 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.641564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79bb3fd7-25b8-4200-8a5c-0c03215b2551 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.641564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79bb3fd7-25b8-4200-8a5c-0c03215b2551 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.641963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79bb3fd7-25b8-4200-8a5c-0c03215b2551 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.642107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79bb3fd7-25b8-4200-8a5c-0c03215b2551 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.679043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-79bb3fd7-25b8-4200-8a5c-0c03215b2551 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053165 Aug 29 22:49:22.679043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 362/736] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:22.931876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:22.932723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:22.939829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.940387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.940830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.941531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.942172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.942598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.021708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:23.030531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f2c6c351-2146-49c0-9ef4-bab5d97ae84c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1508 microversion: 2.1 time: 0.103423 Aug 29 22:49:23.031127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 375/737] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:22 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1508 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:23.118689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-247d2841-5a3f-433b-86c9-364fa190be2c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:23.121281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-247d2841-5a3f-433b-86c9-364fa190be2c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:23.127942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-247d2841-5a3f-433b-86c9-364fa190be2c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.128464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-247d2841-5a3f-433b-86c9-364fa190be2c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.128939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-247d2841-5a3f-433b-86c9-364fa190be2c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.129674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-247d2841-5a3f-433b-86c9-364fa190be2c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.130125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-247d2841-5a3f-433b-86c9-364fa190be2c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.130548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-247d2841-5a3f-433b-86c9-364fa190be2c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.164299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-247d2841-5a3f-433b-86c9-364fa190be2c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050126 Aug 29 22:49:23.165300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 363/738] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:23.350964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-0145b3e2-fdfb-44ad-880c-d8922e369f61 req-1a3f9e67-3fa0-42b6-a516-b854f683d7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b697cf12-f552-4b39-89fe-062c61614073", "name": "network-vif-deleted", "tag": "ade16d2d-3668-4793-a70a-d4f465108efa"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:23.365607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-0145b3e2-fdfb-44ad-880c-d8922e369f61 req-1a3f9e67-3fa0-42b6-a516-b854f683d7aa service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.366541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-0145b3e2-fdfb-44ad-880c-d8922e369f61 req-1a3f9e67-3fa0-42b6-a516-b854f683d7aa service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.367504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-0145b3e2-fdfb-44ad-880c-d8922e369f61 req-1a3f9e67-3fa0-42b6-a516-b854f683d7aa service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.385709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-0145b3e2-fdfb-44ad-880c-d8922e369f61 req-1a3f9e67-3fa0-42b6-a516-b854f683d7aa service nova] Creating event network-vif-deleted:ade16d2d-3668-4793-a70a-d4f465108efa for instance b697cf12-f552-4b39-89fe-062c61614073 on hv-cinder-85426 Aug 29 22:49:23.393110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-0145b3e2-fdfb-44ad-880c-d8922e369f61 req-1a3f9e67-3fa0-42b6-a516-b854f683d7aa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112111 Aug 29 22:49:23.398640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 376/739] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:23.479364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:23.483392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:23.493083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.493738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.494683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.495974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.496558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.497177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.552892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-84b06f7b-ad77-4d29-8028-e2690442bf9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:23.556854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-84b06f7b-ad77-4d29-8028-e2690442bf9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:23.575240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b06f7b-ad77-4d29-8028-e2690442bf9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.576915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b06f7b-ad77-4d29-8028-e2690442bf9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.577584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b06f7b-ad77-4d29-8028-e2690442bf9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.578754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b06f7b-ad77-4d29-8028-e2690442bf9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.579416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b06f7b-ad77-4d29-8028-e2690442bf9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.580062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84b06f7b-ad77-4d29-8028-e2690442bf9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.623889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-84b06f7b-ad77-4d29-8028-e2690442bf9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077474 Aug 29 22:49:23.624860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 377/740] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:23.690105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-122ed94c-91a1-4c08-8e2f-c3aa6dc28404 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:23.692898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-122ed94c-91a1-4c08-8e2f-c3aa6dc28404 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:23.701247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-122ed94c-91a1-4c08-8e2f-c3aa6dc28404 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.703491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-122ed94c-91a1-4c08-8e2f-c3aa6dc28404 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.703491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-122ed94c-91a1-4c08-8e2f-c3aa6dc28404 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.703491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-122ed94c-91a1-4c08-8e2f-c3aa6dc28404 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.704741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-122ed94c-91a1-4c08-8e2f-c3aa6dc28404 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.705420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-122ed94c-91a1-4c08-8e2f-c3aa6dc28404 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.750170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-122ed94c-91a1-4c08-8e2f-c3aa6dc28404 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065862 Aug 29 22:49:23.751383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 378/741] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:23.867694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:23.877456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-56309cf6-f1d1-424e-acc7-f6007e431f8e tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1240 microversion: 2.1 time: 0.403199 Aug 29 22:49:23.880022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 364/742] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:23 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1240 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:24.053692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:24.055191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:24.062165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.075255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.075255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.075255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.075255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.075716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.139492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:24.154090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b8a20504-9888-42ab-922c-f85439cc98de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.104583 Aug 29 22:49:24.154931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 379/743] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:24 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:24.178586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5486d0c6-402c-48ac-8b7d-5858a2e43721 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:24.195737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5486d0c6-402c-48ac-8b7d-5858a2e43721 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:24.195737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:24.195737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5486d0c6-402c-48ac-8b7d-5858a2e43721 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.195737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5486d0c6-402c-48ac-8b7d-5858a2e43721 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.196911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5486d0c6-402c-48ac-8b7d-5858a2e43721 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.196911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5486d0c6-402c-48ac-8b7d-5858a2e43721 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.196911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5486d0c6-402c-48ac-8b7d-5858a2e43721 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.196911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5486d0c6-402c-48ac-8b7d-5858a2e43721 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.207981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:24.226912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5486d0c6-402c-48ac-8b7d-5858a2e43721 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052600 Aug 29 22:49:24.227494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 365/744] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:24.638429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2705cf8b-ed40-42c5-bdda-b15663bf2782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:24.640849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2705cf8b-ed40-42c5-bdda-b15663bf2782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:24.648047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2705cf8b-ed40-42c5-bdda-b15663bf2782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.648713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2705cf8b-ed40-42c5-bdda-b15663bf2782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.649140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2705cf8b-ed40-42c5-bdda-b15663bf2782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.649842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2705cf8b-ed40-42c5-bdda-b15663bf2782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.650284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2705cf8b-ed40-42c5-bdda-b15663bf2782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.650730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2705cf8b-ed40-42c5-bdda-b15663bf2782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.682534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2705cf8b-ed40-42c5-bdda-b15663bf2782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047994 Aug 29 22:49:24.683033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 380/745] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:24.763893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-00ceb839-5a6f-497d-bdff-e84f46de52b5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:24.766149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-00ceb839-5a6f-497d-bdff-e84f46de52b5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:24.774263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ceb839-5a6f-497d-bdff-e84f46de52b5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.774820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ceb839-5a6f-497d-bdff-e84f46de52b5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.775262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ceb839-5a6f-497d-bdff-e84f46de52b5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.776072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ceb839-5a6f-497d-bdff-e84f46de52b5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.776559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ceb839-5a6f-497d-bdff-e84f46de52b5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.776982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ceb839-5a6f-497d-bdff-e84f46de52b5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.810571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-00ceb839-5a6f-497d-bdff-e84f46de52b5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051142 Aug 29 22:49:24.811155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 366/746] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:24.901442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:24.902059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:24.908272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.908759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.909200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.909892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.910349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.910879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.976111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:24.985054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fb1ad5b3-3023-44d9-b7d9-81a397dfa4a4 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1288 microversion: 2.1 time: 0.088473 Aug 29 22:49:24.989510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 381/747] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:24 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:25.175781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:25.178771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:25.183583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.184361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.184975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.185724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.186183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.186608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.239572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2d81abcc-599d-4451-a589-f370744be4ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:25.242114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2d81abcc-599d-4451-a589-f370744be4ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:25.248959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d81abcc-599d-4451-a589-f370744be4ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.249452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d81abcc-599d-4451-a589-f370744be4ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.249884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d81abcc-599d-4451-a589-f370744be4ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.250592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d81abcc-599d-4451-a589-f370744be4ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.251057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d81abcc-599d-4451-a589-f370744be4ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.251479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2d81abcc-599d-4451-a589-f370744be4ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.271315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:25.280294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7e9bff41-7b60-4c4c-ac8b-7248484f5e8f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.109196 Aug 29 22:49:25.293421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2d81abcc-599d-4451-a589-f370744be4ef tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057838 Aug 29 22:49:25.293795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 367/748] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:25.294770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 382/749] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:25.697178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9dfd2b44-9f67-4384-af02-868cee330331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:25.699556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9dfd2b44-9f67-4384-af02-868cee330331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:25.709978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9dfd2b44-9f67-4384-af02-868cee330331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.710648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9dfd2b44-9f67-4384-af02-868cee330331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.711339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9dfd2b44-9f67-4384-af02-868cee330331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.712383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9dfd2b44-9f67-4384-af02-868cee330331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.713146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9dfd2b44-9f67-4384-af02-868cee330331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.713620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9dfd2b44-9f67-4384-af02-868cee330331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.749803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9dfd2b44-9f67-4384-af02-868cee330331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058279 Aug 29 22:49:25.750399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 368/750] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:25.823668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0f1521bc-5c01-4f11-8f21-772edd92e35a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:25.825857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0f1521bc-5c01-4f11-8f21-772edd92e35a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:25.832549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f1521bc-5c01-4f11-8f21-772edd92e35a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.834278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f1521bc-5c01-4f11-8f21-772edd92e35a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.834278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f1521bc-5c01-4f11-8f21-772edd92e35a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.834278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f1521bc-5c01-4f11-8f21-772edd92e35a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:25.834686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f1521bc-5c01-4f11-8f21-772edd92e35a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:25.835110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f1521bc-5c01-4f11-8f21-772edd92e35a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.867353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0f1521bc-5c01-4f11-8f21-772edd92e35a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047572 Aug 29 22:49:25.867950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 383/751] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:26.006297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:26.007087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:26.014288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.014712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.015118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.016051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.017618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.017618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.235570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:26.245464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-81645ac1-58ea-4623-a4c7-be8dd8ba47c1 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1361 microversion: 2.1 time: 0.242795 Aug 29 22:49:26.249929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 369/752] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:26 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:26.301857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:26.303111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:26.310932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bec3b9ff-c473-4cef-8991-2a266f3f52d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:26.315416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bec3b9ff-c473-4cef-8991-2a266f3f52d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:26.315649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.316097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.316557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.317272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.317755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.318177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.327246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bec3b9ff-c473-4cef-8991-2a266f3f52d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.332311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bec3b9ff-c473-4cef-8991-2a266f3f52d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.332311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bec3b9ff-c473-4cef-8991-2a266f3f52d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.332311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bec3b9ff-c473-4cef-8991-2a266f3f52d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.332311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bec3b9ff-c473-4cef-8991-2a266f3f52d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.332724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bec3b9ff-c473-4cef-8991-2a266f3f52d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.393335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bec3b9ff-c473-4cef-8991-2a266f3f52d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090002 Aug 29 22:49:26.394477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 370/753] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:26.411366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:26.422655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-66f65b8f-d218-46bd-9bcf-55f8a60dee13 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.124902 Aug 29 22:49:26.424175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 384/754] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:26.764069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-045befa9-1e24-4b12-a691-c4d8d201b292 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:26.766343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-045befa9-1e24-4b12-a691-c4d8d201b292 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:26.772309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045befa9-1e24-4b12-a691-c4d8d201b292 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.772825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045befa9-1e24-4b12-a691-c4d8d201b292 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.774385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045befa9-1e24-4b12-a691-c4d8d201b292 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.775128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045befa9-1e24-4b12-a691-c4d8d201b292 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.775578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045befa9-1e24-4b12-a691-c4d8d201b292 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.776002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045befa9-1e24-4b12-a691-c4d8d201b292 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.808631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-045befa9-1e24-4b12-a691-c4d8d201b292 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049697 Aug 29 22:49:26.809213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 371/755] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:26.868858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-e03312a6-a08a-4164-b9ff-06988fb07c9e req-06f9afec-f722-4f29-9ecf-db99efad8a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e2d0b8-7d5e-49f6-80b8-64eada460383", "tag": "b48581e0-9ac6-4388-9fa1-66cc4c5eb59a"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:26.879497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-e03312a6-a08a-4164-b9ff-06988fb07c9e req-06f9afec-f722-4f29-9ecf-db99efad8a05 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.880067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-e03312a6-a08a-4164-b9ff-06988fb07c9e req-06f9afec-f722-4f29-9ecf-db99efad8a05 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.880629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-e03312a6-a08a-4164-b9ff-06988fb07c9e req-06f9afec-f722-4f29-9ecf-db99efad8a05 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.882229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bd18a558-82dc-42b2-a89f-28c887307b8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:26.884980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bd18a558-82dc-42b2-a89f-28c887307b8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:26.891762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd18a558-82dc-42b2-a89f-28c887307b8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.892500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd18a558-82dc-42b2-a89f-28c887307b8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.893126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd18a558-82dc-42b2-a89f-28c887307b8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.894029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd18a558-82dc-42b2-a89f-28c887307b8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.894285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-e03312a6-a08a-4164-b9ff-06988fb07c9e req-06f9afec-f722-4f29-9ecf-db99efad8a05 service nova] Creating event network-changed:b48581e0-9ac6-4388-9fa1-66cc4c5eb59a for instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 on hv-cinder-85426 Aug 29 22:49:26.894482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd18a558-82dc-42b2-a89f-28c887307b8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.894900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd18a558-82dc-42b2-a89f-28c887307b8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.900426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-e03312a6-a08a-4164-b9ff-06988fb07c9e req-06f9afec-f722-4f29-9ecf-db99efad8a05 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036577 Aug 29 22:49:26.901412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 385/756] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:26.928725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bd18a558-82dc-42b2-a89f-28c887307b8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050304 Aug 29 22:49:26.930372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 372/757] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:27.267754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:27.268486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:27.276640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.277128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.277563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.278263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.278775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.279234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.297720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:27.408547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-323ec159-aa61-472a-add2-309c16283f62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:27.410757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-323ec159-aa61-472a-add2-309c16283f62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:27.420125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-323ec159-aa61-472a-add2-309c16283f62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.420912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-323ec159-aa61-472a-add2-309c16283f62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.421532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-323ec159-aa61-472a-add2-309c16283f62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.422486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-323ec159-aa61-472a-add2-309c16283f62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.423118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-323ec159-aa61-472a-add2-309c16283f62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.424157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-323ec159-aa61-472a-add2-309c16283f62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.436112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:27.444404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-90e384da-6363-4111-8153-ec672b7ab675 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1361 microversion: 2.1 time: 0.180972 Aug 29 22:49:27.445661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 386/758] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:27 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:27.459099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:27.461398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:27.463641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-323ec159-aa61-472a-add2-309c16283f62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060352 Aug 29 22:49:27.464382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 373/759] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:27.470628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.471308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.471855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.472735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.473199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.473629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.540466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:27.548505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e0b3d96b-003b-44ea-9ad4-b94781214c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.096146 Aug 29 22:49:27.561822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 387/760] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:27 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:27.821330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7921eb4c-ff54-4c12-83a2-a63051261799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:27.823871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7921eb4c-ff54-4c12-83a2-a63051261799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:27.829938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7921eb4c-ff54-4c12-83a2-a63051261799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.830417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7921eb4c-ff54-4c12-83a2-a63051261799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.830840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7921eb4c-ff54-4c12-83a2-a63051261799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.831778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7921eb4c-ff54-4c12-83a2-a63051261799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.832249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7921eb4c-ff54-4c12-83a2-a63051261799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.832666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7921eb4c-ff54-4c12-83a2-a63051261799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.864162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7921eb4c-ff54-4c12-83a2-a63051261799 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047001 Aug 29 22:49:27.864726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 374/761] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:27 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:27.944661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-caa7a3ed-692c-4269-9d05-e1d5a6fe9d52 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:27.947959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-caa7a3ed-692c-4269-9d05-e1d5a6fe9d52 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:27.954670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caa7a3ed-692c-4269-9d05-e1d5a6fe9d52 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.955158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caa7a3ed-692c-4269-9d05-e1d5a6fe9d52 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.955592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caa7a3ed-692c-4269-9d05-e1d5a6fe9d52 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.956573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caa7a3ed-692c-4269-9d05-e1d5a6fe9d52 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.957029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caa7a3ed-692c-4269-9d05-e1d5a6fe9d52 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.957455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caa7a3ed-692c-4269-9d05-e1d5a6fe9d52 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.989338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-caa7a3ed-692c-4269-9d05-e1d5a6fe9d52 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048719 Aug 29 22:49:27.989922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 388/762] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:28.467327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:28.467966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:28.474649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.475131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.475560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.476335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.476787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.477246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.478977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4634e953-5ebe-4a81-88f9-97661ae2a907 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:28.480235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4634e953-5ebe-4a81-88f9-97661ae2a907 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:28.486808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4634e953-5ebe-4a81-88f9-97661ae2a907 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.487408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4634e953-5ebe-4a81-88f9-97661ae2a907 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.487749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4634e953-5ebe-4a81-88f9-97661ae2a907 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.488492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4634e953-5ebe-4a81-88f9-97661ae2a907 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.488960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4634e953-5ebe-4a81-88f9-97661ae2a907 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.489408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4634e953-5ebe-4a81-88f9-97661ae2a907 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.522856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4634e953-5ebe-4a81-88f9-97661ae2a907 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048664 Aug 29 22:49:28.524095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 389/763] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:28.569500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:28.570683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:28.576964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.577448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.577881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.578572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.579020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.579436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.623949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:28.632286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e159faae-4ed7-4ed2-836c-bb3bf48d828c tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1361 microversion: 2.1 time: 0.168656 Aug 29 22:49:28.633786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 375/764] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:28 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:28.653421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:28.661569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1fc9cab5-3efd-4406-b31f-e68d084e94b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.095872 Aug 29 22:49:28.662124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 390/765] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:28 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:28.877484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-af64687a-f1cb-4104-8f33-43a58ed19a92 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:28.879664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-af64687a-f1cb-4104-8f33-43a58ed19a92 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:28.887371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af64687a-f1cb-4104-8f33-43a58ed19a92 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.888196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af64687a-f1cb-4104-8f33-43a58ed19a92 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.888390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af64687a-f1cb-4104-8f33-43a58ed19a92 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.889117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af64687a-f1cb-4104-8f33-43a58ed19a92 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.889555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af64687a-f1cb-4104-8f33-43a58ed19a92 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.889980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af64687a-f1cb-4104-8f33-43a58ed19a92 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.925678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-af64687a-f1cb-4104-8f33-43a58ed19a92 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051982 Aug 29 22:49:28.926676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 376/766] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:29.002493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f253a325-8a85-44ef-b640-d5a0606ccaaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:29.004805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f253a325-8a85-44ef-b640-d5a0606ccaaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:29.012029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f253a325-8a85-44ef-b640-d5a0606ccaaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.012548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f253a325-8a85-44ef-b640-d5a0606ccaaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.012992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f253a325-8a85-44ef-b640-d5a0606ccaaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.013693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f253a325-8a85-44ef-b640-d5a0606ccaaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.014146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f253a325-8a85-44ef-b640-d5a0606ccaaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.014569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f253a325-8a85-44ef-b640-d5a0606ccaaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.047302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f253a325-8a85-44ef-b640-d5a0606ccaaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048753 Aug 29 22:49:29.047884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 391/767] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:29.536824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d9fc2160-aa2e-4f68-bdcb-76dd67c6a861 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:29.539674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d9fc2160-aa2e-4f68-bdcb-76dd67c6a861 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:29.546510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9fc2160-aa2e-4f68-bdcb-76dd67c6a861 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.547118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9fc2160-aa2e-4f68-bdcb-76dd67c6a861 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.547443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9fc2160-aa2e-4f68-bdcb-76dd67c6a861 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.552301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9fc2160-aa2e-4f68-bdcb-76dd67c6a861 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.552301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9fc2160-aa2e-4f68-bdcb-76dd67c6a861 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.552301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9fc2160-aa2e-4f68-bdcb-76dd67c6a861 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.580533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d9fc2160-aa2e-4f68-bdcb-76dd67c6a861 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047759 Aug 29 22:49:29.581377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 377/768] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:29.655032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:29.655668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:29.661804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.662293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.662729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.663568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.664037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.664581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.682302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:29.684444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:29.689224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.689720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.690161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.690870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.691323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.691752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.763506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:29.771504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2e7a69cc-8861-4db9-808d-43cfc4ed8642 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092952 Aug 29 22:49:29.772015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 378/769] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:29 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:29.807748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:29.816023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f958f137-1257-48d3-983b-f95be743b507 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1361 microversion: 2.1 time: 0.164906 Aug 29 22:49:29.820009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 392/770] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:29 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:29.939191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4a7d4c0d-9dbd-4c27-ae40-c666b348086e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:29.941382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4a7d4c0d-9dbd-4c27-ae40-c666b348086e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:29.947969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4a7d4c0d-9dbd-4c27-ae40-c666b348086e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.948487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4a7d4c0d-9dbd-4c27-ae40-c666b348086e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.948977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4a7d4c0d-9dbd-4c27-ae40-c666b348086e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.949669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4a7d4c0d-9dbd-4c27-ae40-c666b348086e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.950122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4a7d4c0d-9dbd-4c27-ae40-c666b348086e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.950539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4a7d4c0d-9dbd-4c27-ae40-c666b348086e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.981960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4a7d4c0d-9dbd-4c27-ae40-c666b348086e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046805 Aug 29 22:49:29.982537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 379/771] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:30.060084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1d3373ba-003d-4e04-8cc9-fc36c7203d77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:30.062168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1d3373ba-003d-4e04-8cc9-fc36c7203d77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:30.068648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3373ba-003d-4e04-8cc9-fc36c7203d77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.069127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3373ba-003d-4e04-8cc9-fc36c7203d77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.069557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3373ba-003d-4e04-8cc9-fc36c7203d77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.070251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3373ba-003d-4e04-8cc9-fc36c7203d77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.070783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3373ba-003d-4e04-8cc9-fc36c7203d77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.071221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3373ba-003d-4e04-8cc9-fc36c7203d77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.102961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1d3373ba-003d-4e04-8cc9-fc36c7203d77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046890 Aug 29 22:49:30.103528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 393/772] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:30.594567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1cbc7ecb-a6a6-46ed-a6fd-4ffe6ad54a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:30.596889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1cbc7ecb-a6a6-46ed-a6fd-4ffe6ad54a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:30.603444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cbc7ecb-a6a6-46ed-a6fd-4ffe6ad54a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.603924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cbc7ecb-a6a6-46ed-a6fd-4ffe6ad54a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.604485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cbc7ecb-a6a6-46ed-a6fd-4ffe6ad54a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.605529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cbc7ecb-a6a6-46ed-a6fd-4ffe6ad54a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.605991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cbc7ecb-a6a6-46ed-a6fd-4ffe6ad54a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.606422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cbc7ecb-a6a6-46ed-a6fd-4ffe6ad54a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.642315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1cbc7ecb-a6a6-46ed-a6fd-4ffe6ad54a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047937 Aug 29 22:49:30.642315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 380/773] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:30.792788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:30.793400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:30.799446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.799934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.800413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.801113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.801564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.801988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.838355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:30.838876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:30.847517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.848797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.848797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.849205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:30.849683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:30.850267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.869306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:30.877128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-54a7f7c4-ce34-4c9e-b2e9-1f52deb2e44a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088266 Aug 29 22:49:30.877714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 394/774] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:30 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:30.994678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3dd409ee-dbbe-44e1-83f7-ba6c0618ca62 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:30.996948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3dd409ee-dbbe-44e1-83f7-ba6c0618ca62 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:31.000238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:31.003617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd409ee-dbbe-44e1-83f7-ba6c0618ca62 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.004112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd409ee-dbbe-44e1-83f7-ba6c0618ca62 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.004554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:31.004718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd409ee-dbbe-44e1-83f7-ba6c0618ca62 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.005271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd409ee-dbbe-44e1-83f7-ba6c0618ca62 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.005743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd409ee-dbbe-44e1-83f7-ba6c0618ca62 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.006163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd409ee-dbbe-44e1-83f7-ba6c0618ca62 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.011199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-533ed065-2ccf-45c3-a2ee-c865f24b2233 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1361 microversion: 2.1 time: 0.177380 Aug 29 22:49:31.012119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 381/775] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:30 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:31.041322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3dd409ee-dbbe-44e1-83f7-ba6c0618ca62 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051065 Aug 29 22:49:31.041840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 395/776] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:31.115319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9a94fd6c-fc7b-4eea-8522-3da9cdb32ee6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:31.117601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9a94fd6c-fc7b-4eea-8522-3da9cdb32ee6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:31.124557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a94fd6c-fc7b-4eea-8522-3da9cdb32ee6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.125042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a94fd6c-fc7b-4eea-8522-3da9cdb32ee6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.125474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a94fd6c-fc7b-4eea-8522-3da9cdb32ee6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.126179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a94fd6c-fc7b-4eea-8522-3da9cdb32ee6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.126634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a94fd6c-fc7b-4eea-8522-3da9cdb32ee6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.127052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a94fd6c-fc7b-4eea-8522-3da9cdb32ee6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.160186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9a94fd6c-fc7b-4eea-8522-3da9cdb32ee6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048971 Aug 29 22:49:31.160754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 382/777] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:31.652207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b721d9a5-fa13-43ab-a4a6-b42c75979c64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:31.654393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b721d9a5-fa13-43ab-a4a6-b42c75979c64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:31.661103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b721d9a5-fa13-43ab-a4a6-b42c75979c64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.661593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b721d9a5-fa13-43ab-a4a6-b42c75979c64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.662031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b721d9a5-fa13-43ab-a4a6-b42c75979c64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.662740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b721d9a5-fa13-43ab-a4a6-b42c75979c64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.663195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b721d9a5-fa13-43ab-a4a6-b42c75979c64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.665019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b721d9a5-fa13-43ab-a4a6-b42c75979c64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.695505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b721d9a5-fa13-43ab-a4a6-b42c75979c64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048202 Aug 29 22:49:31.696236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 396/778] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:31.900121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:31.900765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:31.907578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.907989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.908449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.909154 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.909609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.910033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.983633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:31.992452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1442ebcf-f4d9-4df6-a707-72a8a52de973 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.096065 Aug 29 22:49:31.993351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 383/779] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:31 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:32.032832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:32.033430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:32.040002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.040512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.040947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.041641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.042095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.042514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.053507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bfba7844-3b1e-452f-8af9-518afa6b0d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:32.056696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bfba7844-3b1e-452f-8af9-518afa6b0d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:32.062758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfba7844-3b1e-452f-8af9-518afa6b0d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.063258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfba7844-3b1e-452f-8af9-518afa6b0d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.063691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfba7844-3b1e-452f-8af9-518afa6b0d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.064428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfba7844-3b1e-452f-8af9-518afa6b0d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.064915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfba7844-3b1e-452f-8af9-518afa6b0d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.065339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfba7844-3b1e-452f-8af9-518afa6b0d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.097198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bfba7844-3b1e-452f-8af9-518afa6b0d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047563 Aug 29 22:49:32.097777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 384/780] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:32.174007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c74d9ccf-1fd3-4298-b6a0-ff954d33fcc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:32.176170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c74d9ccf-1fd3-4298-b6a0-ff954d33fcc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:32.178316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:32.187520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9ab85fa7-d3d6-4821-97d5-02a225d9da9d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1361 microversion: 2.1 time: 0.158639 Aug 29 22:49:32.188257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 397/781] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:32 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:32.188406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74d9ccf-1fd3-4298-b6a0-ff954d33fcc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.188883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74d9ccf-1fd3-4298-b6a0-ff954d33fcc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.189317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74d9ccf-1fd3-4298-b6a0-ff954d33fcc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.190025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74d9ccf-1fd3-4298-b6a0-ff954d33fcc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.190478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74d9ccf-1fd3-4298-b6a0-ff954d33fcc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.190901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74d9ccf-1fd3-4298-b6a0-ff954d33fcc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.229871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c74d9ccf-1fd3-4298-b6a0-ff954d33fcc9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061102 Aug 29 22:49:32.230459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 385/782] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:32.603000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-b70a9285-5c47-40d3-93dd-05b6863d32d4 req-fc8c0e76-207f-4cc9-aadf-e1a651961ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e2d0b8-7d5e-49f6-80b8-64eada460383", "name": "network-vif-plugged", "status": "completed", "tag": "b48581e0-9ac6-4388-9fa1-66cc4c5eb59a"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:32.612750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:32.613496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=10 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:32.616051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-b70a9285-5c47-40d3-93dd-05b6863d32d4 req-fc8c0e76-207f-4cc9-aadf-e1a651961ef7 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.617206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-b70a9285-5c47-40d3-93dd-05b6863d32d4 req-fc8c0e76-207f-4cc9-aadf-e1a651961ef7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.617855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-b70a9285-5c47-40d3-93dd-05b6863d32d4 req-fc8c0e76-207f-4cc9-aadf-e1a651961ef7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.634786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-b70a9285-5c47-40d3-93dd-05b6863d32d4 req-fc8c0e76-207f-4cc9-aadf-e1a651961ef7 service nova] Creating event network-vif-plugged:b48581e0-9ac6-4388-9fa1-66cc4c5eb59a for instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 on hv-cinder-85426 Aug 29 22:49:32.641841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-b70a9285-5c47-40d3-93dd-05b6863d32d4 req-fc8c0e76-207f-4cc9-aadf-e1a651961ef7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043358 Aug 29 22:49:32.642734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 398/783] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:32.710254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c909ee94-d194-4f8e-8d8f-2ce4a7d1a02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:32.712608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c909ee94-d194-4f8e-8d8f-2ce4a7d1a02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:32.714740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:32.720012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c909ee94-d194-4f8e-8d8f-2ce4a7d1a02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.720595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c909ee94-d194-4f8e-8d8f-2ce4a7d1a02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.721022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c909ee94-d194-4f8e-8d8f-2ce4a7d1a02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.721722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c909ee94-d194-4f8e-8d8f-2ce4a7d1a02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.722165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c909ee94-d194-4f8e-8d8f-2ce4a7d1a02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.722578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c909ee94-d194-4f8e-8d8f-2ce4a7d1a02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.757423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c909ee94-d194-4f8e-8d8f-2ce4a7d1a02b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052166 Aug 29 22:49:32.761897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 386/784] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:33.014691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:33.015394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:33.023889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.024670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.025118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.025865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.026331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.026760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.093340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:33.102498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ac648f06-ff91-46f1-b3bc-b42bbf499982 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091180 Aug 29 22:49:33.103114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 399/785] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:33 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:33.113979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2dce7226-ab58-49a4-a1d6-2331e973a2c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:33.116197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2dce7226-ab58-49a4-a1d6-2331e973a2c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:33.123321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2dce7226-ab58-49a4-a1d6-2331e973a2c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.123795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2dce7226-ab58-49a4-a1d6-2331e973a2c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.124253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2dce7226-ab58-49a4-a1d6-2331e973a2c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.124940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2dce7226-ab58-49a4-a1d6-2331e973a2c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.125386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2dce7226-ab58-49a4-a1d6-2331e973a2c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.125803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2dce7226-ab58-49a4-a1d6-2331e973a2c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.155767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2dce7226-ab58-49a4-a1d6-2331e973a2c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045701 Aug 29 22:49:33.156370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 387/786] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:33.208873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:33.209476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:33.219932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.220463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.220907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.221685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.222079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.222498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.242351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-822e4f8c-c6eb-4454-9bdf-8576fcea253a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:33.244928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-822e4f8c-c6eb-4454-9bdf-8576fcea253a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:33.251142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-822e4f8c-c6eb-4454-9bdf-8576fcea253a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.251629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-822e4f8c-c6eb-4454-9bdf-8576fcea253a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.252067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-822e4f8c-c6eb-4454-9bdf-8576fcea253a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.252800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-822e4f8c-c6eb-4454-9bdf-8576fcea253a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.253257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-822e4f8c-c6eb-4454-9bdf-8576fcea253a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.253865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-822e4f8c-c6eb-4454-9bdf-8576fcea253a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.286483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-822e4f8c-c6eb-4454-9bdf-8576fcea253a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048053 Aug 29 22:49:33.287307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 388/787] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:33.369256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:33.383844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a16fc512-a506-4d1a-bc8b-13404542e2ae tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1361 microversion: 2.1 time: 0.178652 Aug 29 22:49:33.384540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 400/788] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:33 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:33.769781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-999d959a-78bd-45c2-bfe5-02817c352d43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:33.772020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-999d959a-78bd-45c2-bfe5-02817c352d43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:33.779125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-999d959a-78bd-45c2-bfe5-02817c352d43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.779605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-999d959a-78bd-45c2-bfe5-02817c352d43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.780038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-999d959a-78bd-45c2-bfe5-02817c352d43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.780760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-999d959a-78bd-45c2-bfe5-02817c352d43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.781216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-999d959a-78bd-45c2-bfe5-02817c352d43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.781635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-999d959a-78bd-45c2-bfe5-02817c352d43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.814655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-999d959a-78bd-45c2-bfe5-02817c352d43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048682 Aug 29 22:49:33.815380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 389/789] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:34.123636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:34.124331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:34.130774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.131255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.131684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.133135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.133604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.134070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.167864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7e437e91-d4b7-40d4-a57d-9cba00cf5a6f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:34.170065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7e437e91-d4b7-40d4-a57d-9cba00cf5a6f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:34.176640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e437e91-d4b7-40d4-a57d-9cba00cf5a6f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.177122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e437e91-d4b7-40d4-a57d-9cba00cf5a6f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.177556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e437e91-d4b7-40d4-a57d-9cba00cf5a6f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.178256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e437e91-d4b7-40d4-a57d-9cba00cf5a6f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.178706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e437e91-d4b7-40d4-a57d-9cba00cf5a6f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.179860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7e437e91-d4b7-40d4-a57d-9cba00cf5a6f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.197960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:34.205713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-14a11273-8e50-4506-8f6d-2bce77b906dc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085878 Aug 29 22:49:34.206797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 401/790] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:34 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:34.211175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7e437e91-d4b7-40d4-a57d-9cba00cf5a6f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047536 Aug 29 22:49:34.211742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 390/791] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:34.299081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dea7392d-a053-46a2-9ee3-a82c036b9a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:34.301235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dea7392d-a053-46a2-9ee3-a82c036b9a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:34.307842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dea7392d-a053-46a2-9ee3-a82c036b9a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.308351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dea7392d-a053-46a2-9ee3-a82c036b9a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.308783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dea7392d-a053-46a2-9ee3-a82c036b9a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.309473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dea7392d-a053-46a2-9ee3-a82c036b9a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.309919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dea7392d-a053-46a2-9ee3-a82c036b9a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.310335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dea7392d-a053-46a2-9ee3-a82c036b9a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.340913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dea7392d-a053-46a2-9ee3-a82c036b9a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 Aug 29 22:49:34.341493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 402/792] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:34.405438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:34.405959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:34.411985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.412504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.412949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.414204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.414656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.415081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.554508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:34.563582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-301e1088-bb69-4588-9a12-1c8ea2303bce tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1361 microversion: 2.1 time: 0.162052 Aug 29 22:49:34.564279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 391/793] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:34 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:34.826868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-00ea0a20-e840-4573-a0be-a38a207c5b32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:34.829055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-00ea0a20-e840-4573-a0be-a38a207c5b32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:34.835867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00ea0a20-e840-4573-a0be-a38a207c5b32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.840088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00ea0a20-e840-4573-a0be-a38a207c5b32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.840088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00ea0a20-e840-4573-a0be-a38a207c5b32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.840088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00ea0a20-e840-4573-a0be-a38a207c5b32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.840088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00ea0a20-e840-4573-a0be-a38a207c5b32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.840843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00ea0a20-e840-4573-a0be-a38a207c5b32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.865579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:34.871059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-00ea0a20-e840-4573-a0be-a38a207c5b32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048349 Aug 29 22:49:34.871645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 403/794] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:35.223982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c22abeb0-a1bb-4f58-a8c3-f767a6875c8d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:35.226358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c22abeb0-a1bb-4f58-a8c3-f767a6875c8d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:35.227139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:35.227777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:35.233083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c22abeb0-a1bb-4f58-a8c3-f767a6875c8d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.233727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c22abeb0-a1bb-4f58-a8c3-f767a6875c8d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.234160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c22abeb0-a1bb-4f58-a8c3-f767a6875c8d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.234733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.234856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c22abeb0-a1bb-4f58-a8c3-f767a6875c8d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.235221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.235349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c22abeb0-a1bb-4f58-a8c3-f767a6875c8d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.235653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.235821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c22abeb0-a1bb-4f58-a8c3-f767a6875c8d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.236376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.236831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.237324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.268239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c22abeb0-a1bb-4f58-a8c3-f767a6875c8d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048795 Aug 29 22:49:35.268987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 392/795] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:35.301224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:35.310023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3eaed5ae-60a0-4f24-8881-0dfa8a9aa277 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087049 Aug 29 22:49:35.310597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 404/796] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:35 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:35.354133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4303bbaa-02c5-47ee-a02f-a15568736f89 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:35.356442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4303bbaa-02c5-47ee-a02f-a15568736f89 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:35.363289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4303bbaa-02c5-47ee-a02f-a15568736f89 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.363777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4303bbaa-02c5-47ee-a02f-a15568736f89 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.364237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4303bbaa-02c5-47ee-a02f-a15568736f89 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.364944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4303bbaa-02c5-47ee-a02f-a15568736f89 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.365397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4303bbaa-02c5-47ee-a02f-a15568736f89 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.365811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4303bbaa-02c5-47ee-a02f-a15568736f89 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.405504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4303bbaa-02c5-47ee-a02f-a15568736f89 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055789 Aug 29 22:49:35.406109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 393/797] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:35.586149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:35.586705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:35.592663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.593142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.593574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.594267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.594717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.595137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.731400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:35.739065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7b3b3574-0bcf-4921-ae3d-e7a299ede739 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1548 microversion: 2.1 time: 0.156990 Aug 29 22:49:35.739635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 405/798] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:35 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:35.759935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-936c0d5a-6d7e-4479-b60f-60fd59ad42dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:35.760446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-936c0d5a-6d7e-4479-b60f-60fd59ad42dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:35.766546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-936c0d5a-6d7e-4479-b60f-60fd59ad42dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.767135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-936c0d5a-6d7e-4479-b60f-60fd59ad42dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.767462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-936c0d5a-6d7e-4479-b60f-60fd59ad42dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.768200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-936c0d5a-6d7e-4479-b60f-60fd59ad42dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.768620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-936c0d5a-6d7e-4479-b60f-60fd59ad42dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.769038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-936c0d5a-6d7e-4479-b60f-60fd59ad42dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.847210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-936c0d5a-6d7e-4479-b60f-60fd59ad42dd tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091308 Aug 29 22:49:35.847800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 394/799] 10.222.0.59 () {58 vars in 1275 bytes} [Mon Aug 29 22:49:35 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:35.883267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bb81e223-0742-4a9e-ac46-cf6af22434fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:35.885460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bb81e223-0742-4a9e-ac46-cf6af22434fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:35.891482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb81e223-0742-4a9e-ac46-cf6af22434fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.891972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb81e223-0742-4a9e-ac46-cf6af22434fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.892445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb81e223-0742-4a9e-ac46-cf6af22434fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.893174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb81e223-0742-4a9e-ac46-cf6af22434fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.893632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb81e223-0742-4a9e-ac46-cf6af22434fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.894055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb81e223-0742-4a9e-ac46-cf6af22434fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.927618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bb81e223-0742-4a9e-ac46-cf6af22434fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048526 Aug 29 22:49:35.928219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 406/800] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:36.282563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0f653fbb-da13-4d2a-8395-1d9a6c569838 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:36.284792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0f653fbb-da13-4d2a-8395-1d9a6c569838 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:36.292243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f653fbb-da13-4d2a-8395-1d9a6c569838 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.292736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f653fbb-da13-4d2a-8395-1d9a6c569838 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.293174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f653fbb-da13-4d2a-8395-1d9a6c569838 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.293883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f653fbb-da13-4d2a-8395-1d9a6c569838 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.294336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f653fbb-da13-4d2a-8395-1d9a6c569838 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.294775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f653fbb-da13-4d2a-8395-1d9a6c569838 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.328417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0f653fbb-da13-4d2a-8395-1d9a6c569838 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050396 Aug 29 22:49:36.329004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 395/801] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:36.331647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:36.332513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:36.338950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.339525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.340033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.340814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.341331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.341818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.405393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:36.414088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2696965f-0f37-4e6c-928c-c3256ec191a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086271 Aug 29 22:49:36.414879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 407/802] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:36 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:36.419718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c8116e39-ea4e-4f34-a3c8-e28cd789582d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:36.420406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c8116e39-ea4e-4f34-a3c8-e28cd789582d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:36.426692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8116e39-ea4e-4f34-a3c8-e28cd789582d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.427173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8116e39-ea4e-4f34-a3c8-e28cd789582d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.427635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8116e39-ea4e-4f34-a3c8-e28cd789582d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.428496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8116e39-ea4e-4f34-a3c8-e28cd789582d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.429573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8116e39-ea4e-4f34-a3c8-e28cd789582d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.430000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8116e39-ea4e-4f34-a3c8-e28cd789582d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.463144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c8116e39-ea4e-4f34-a3c8-e28cd789582d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049406 Aug 29 22:49:36.463649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 396/803] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:36.862424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-7ef2be03-ed24-4beb-899a-1807f6020d28 req-7c51a742-5851-4db8-a37b-61f3a4ca47fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e2d0b8-7d5e-49f6-80b8-64eada460383", "tag": "b48581e0-9ac6-4388-9fa1-66cc4c5eb59a"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:36.873301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-7ef2be03-ed24-4beb-899a-1807f6020d28 req-7c51a742-5851-4db8-a37b-61f3a4ca47fb service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.873782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-7ef2be03-ed24-4beb-899a-1807f6020d28 req-7c51a742-5851-4db8-a37b-61f3a4ca47fb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.874306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-7ef2be03-ed24-4beb-899a-1807f6020d28 req-7c51a742-5851-4db8-a37b-61f3a4ca47fb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.886370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-7ef2be03-ed24-4beb-899a-1807f6020d28 req-7c51a742-5851-4db8-a37b-61f3a4ca47fb service nova] Creating event network-changed:b48581e0-9ac6-4388-9fa1-66cc4c5eb59a for instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 on hv-cinder-85426 Aug 29 22:49:36.891316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-7ef2be03-ed24-4beb-899a-1807f6020d28 req-7c51a742-5851-4db8-a37b-61f3a4ca47fb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032565 Aug 29 22:49:36.891946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 408/804] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:36.941357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ebd99b59-f568-47fb-b95a-17ba1084adfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:36.943559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ebd99b59-f568-47fb-b95a-17ba1084adfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:36.951842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebd99b59-f568-47fb-b95a-17ba1084adfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.952737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebd99b59-f568-47fb-b95a-17ba1084adfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.952871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebd99b59-f568-47fb-b95a-17ba1084adfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.953504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebd99b59-f568-47fb-b95a-17ba1084adfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.953961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebd99b59-f568-47fb-b95a-17ba1084adfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.954599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebd99b59-f568-47fb-b95a-17ba1084adfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.990515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ebd99b59-f568-47fb-b95a-17ba1084adfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053349 Aug 29 22:49:36.995641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 397/805] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:37.343275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b2190f15-b081-428f-821b-8ecc163da382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:37.345769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b2190f15-b081-428f-821b-8ecc163da382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:37.354193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2190f15-b081-428f-821b-8ecc163da382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.354946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2190f15-b081-428f-821b-8ecc163da382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.355591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2190f15-b081-428f-821b-8ecc163da382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.356391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2190f15-b081-428f-821b-8ecc163da382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.356861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2190f15-b081-428f-821b-8ecc163da382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.357289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2190f15-b081-428f-821b-8ecc163da382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.390343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b2190f15-b081-428f-821b-8ecc163da382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052052 Aug 29 22:49:37.394946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 409/806] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:37.435648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:37.436454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:37.443961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.445037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.445732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.446590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.447160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.447599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.476826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5de9ac91-2d91-4dc7-8b21-209730078a66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:37.480068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5de9ac91-2d91-4dc7-8b21-209730078a66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:37.487453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de9ac91-2d91-4dc7-8b21-209730078a66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.487922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de9ac91-2d91-4dc7-8b21-209730078a66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.488385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de9ac91-2d91-4dc7-8b21-209730078a66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.489283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de9ac91-2d91-4dc7-8b21-209730078a66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.489896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de9ac91-2d91-4dc7-8b21-209730078a66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.490478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de9ac91-2d91-4dc7-8b21-209730078a66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.523992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:37.527798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:37.528381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5de9ac91-2d91-4dc7-8b21-209730078a66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056475 Aug 29 22:49:37.531551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 410/807] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:37.534914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dd0ae286-a835-4cd0-93d2-d9af80f21de9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.103701 Aug 29 22:49:37.535489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 398/808] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:37 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:38.003326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dbfe15f8-2248-46e5-b08e-d99e25b87fdf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:38.006372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dbfe15f8-2248-46e5-b08e-d99e25b87fdf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:38.013238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbfe15f8-2248-46e5-b08e-d99e25b87fdf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.017957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbfe15f8-2248-46e5-b08e-d99e25b87fdf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.017957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbfe15f8-2248-46e5-b08e-d99e25b87fdf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.017957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbfe15f8-2248-46e5-b08e-d99e25b87fdf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.017957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbfe15f8-2248-46e5-b08e-d99e25b87fdf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.018330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbfe15f8-2248-46e5-b08e-d99e25b87fdf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.050062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dbfe15f8-2248-46e5-b08e-d99e25b87fdf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050773 Aug 29 22:49:38.050648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 411/809] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:38.403640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5a5ce9de-6fe1-4bec-a0a2-66188195dbc8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:38.405881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5a5ce9de-6fe1-4bec-a0a2-66188195dbc8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:38.412356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a5ce9de-6fe1-4bec-a0a2-66188195dbc8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.412839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a5ce9de-6fe1-4bec-a0a2-66188195dbc8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.413906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a5ce9de-6fe1-4bec-a0a2-66188195dbc8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.414871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a5ce9de-6fe1-4bec-a0a2-66188195dbc8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.415327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a5ce9de-6fe1-4bec-a0a2-66188195dbc8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.415766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a5ce9de-6fe1-4bec-a0a2-66188195dbc8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.448870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5a5ce9de-6fe1-4bec-a0a2-66188195dbc8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048858 Aug 29 22:49:38.454556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 399/810] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:38.542109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fb9e9364-2e4e-4352-a6c6-336056afd96b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:38.544500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fb9e9364-2e4e-4352-a6c6-336056afd96b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:38.551190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb9e9364-2e4e-4352-a6c6-336056afd96b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.551680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb9e9364-2e4e-4352-a6c6-336056afd96b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.552162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb9e9364-2e4e-4352-a6c6-336056afd96b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.552886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb9e9364-2e4e-4352-a6c6-336056afd96b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.553344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb9e9364-2e4e-4352-a6c6-336056afd96b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.553772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb9e9364-2e4e-4352-a6c6-336056afd96b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.554746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:38.555281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:38.561382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.561857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.562286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.562967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.563414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.563834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.584824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fb9e9364-2e4e-4352-a6c6-336056afd96b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Aug 29 22:49:38.589992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 412/811] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:38.628359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:38.636811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-868ce471-307e-42c5-ab42-9ca14d3b948e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085926 Aug 29 22:49:38.637397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 400/812] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:38 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:39.063387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d0174f9a-9f4d-47f6-9a43-d9e7fffb10f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:39.065641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d0174f9a-9f4d-47f6-9a43-d9e7fffb10f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:39.071831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0174f9a-9f4d-47f6-9a43-d9e7fffb10f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.072360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0174f9a-9f4d-47f6-9a43-d9e7fffb10f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.072804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0174f9a-9f4d-47f6-9a43-d9e7fffb10f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.073564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0174f9a-9f4d-47f6-9a43-d9e7fffb10f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.073968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0174f9a-9f4d-47f6-9a43-d9e7fffb10f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.074386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0174f9a-9f4d-47f6-9a43-d9e7fffb10f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.105840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d0174f9a-9f4d-47f6-9a43-d9e7fffb10f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046489 Aug 29 22:49:39.106416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 413/813] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:39.462258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a4205da3-803a-453c-a349-a6d00cbd9b84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:39.464430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a4205da3-803a-453c-a349-a6d00cbd9b84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:39.470846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4205da3-803a-453c-a349-a6d00cbd9b84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.471327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4205da3-803a-453c-a349-a6d00cbd9b84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.471763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4205da3-803a-453c-a349-a6d00cbd9b84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.472490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4205da3-803a-453c-a349-a6d00cbd9b84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.472947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4205da3-803a-453c-a349-a6d00cbd9b84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.473370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4205da3-803a-453c-a349-a6d00cbd9b84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.503245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a4205da3-803a-453c-a349-a6d00cbd9b84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045787 Aug 29 22:49:39.503803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 401/814] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:39.597674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f5a45ffc-89ec-4233-80ec-2291f8404244 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:39.599805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f5a45ffc-89ec-4233-80ec-2291f8404244 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:39.606815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a45ffc-89ec-4233-80ec-2291f8404244 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.607291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a45ffc-89ec-4233-80ec-2291f8404244 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.607718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a45ffc-89ec-4233-80ec-2291f8404244 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.608480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a45ffc-89ec-4233-80ec-2291f8404244 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.608928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a45ffc-89ec-4233-80ec-2291f8404244 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.609348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a45ffc-89ec-4233-80ec-2291f8404244 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.641574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f5a45ffc-89ec-4233-80ec-2291f8404244 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047905 Aug 29 22:49:39.642138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 414/815] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:39.657853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:39.658466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:39.664753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.665244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.665685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.666383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.666839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.667266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.729550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:39.737683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3e4afade-4e8d-498e-a8ad-85c2b625dc1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.083745 Aug 29 22:49:39.738259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 402/816] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:39 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:40.118917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-949001f0-8336-42c5-99ce-187587447ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:40.121145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-949001f0-8336-42c5-99ce-187587447ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:40.127238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949001f0-8336-42c5-99ce-187587447ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.127727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949001f0-8336-42c5-99ce-187587447ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.128192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949001f0-8336-42c5-99ce-187587447ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.128917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949001f0-8336-42c5-99ce-187587447ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.129357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949001f0-8336-42c5-99ce-187587447ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.129784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949001f0-8336-42c5-99ce-187587447ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.160814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-949001f0-8336-42c5-99ce-187587447ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046512 Aug 29 22:49:40.161386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 415/817] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:40.515172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5aea7b4b-614f-405e-bd7d-93414c70f7b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:40.517287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5aea7b4b-614f-405e-bd7d-93414c70f7b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:40.524564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5aea7b4b-614f-405e-bd7d-93414c70f7b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.525051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5aea7b4b-614f-405e-bd7d-93414c70f7b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.525488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5aea7b4b-614f-405e-bd7d-93414c70f7b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.526191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5aea7b4b-614f-405e-bd7d-93414c70f7b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.526642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5aea7b4b-614f-405e-bd7d-93414c70f7b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.527072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5aea7b4b-614f-405e-bd7d-93414c70f7b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.557603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5aea7b4b-614f-405e-bd7d-93414c70f7b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046428 Aug 29 22:49:40.558170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 403/818] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:40 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:40.654269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1d8a8dab-4ee2-4c50-a9b8-1d29f5b25038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:40.656461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1d8a8dab-4ee2-4c50-a9b8-1d29f5b25038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:40.662818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d8a8dab-4ee2-4c50-a9b8-1d29f5b25038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.663305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d8a8dab-4ee2-4c50-a9b8-1d29f5b25038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.663734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d8a8dab-4ee2-4c50-a9b8-1d29f5b25038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.664540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d8a8dab-4ee2-4c50-a9b8-1d29f5b25038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.664994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d8a8dab-4ee2-4c50-a9b8-1d29f5b25038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.665416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d8a8dab-4ee2-4c50-a9b8-1d29f5b25038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.697037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1d8a8dab-4ee2-4c50-a9b8-1d29f5b25038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046663 Aug 29 22:49:40.697613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 416/819] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:40.759395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:40.760122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:40.766412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.766829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.767270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.767968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.768459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.768886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.834487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:40.842684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7f2c8c27-c89e-4b39-ae11-12815c25ec08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088090 Aug 29 22:49:40.843267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 404/820] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:40 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:41.174054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fd240604-e18d-48a2-901a-ccd24e9dbd34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:41.178098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fd240604-e18d-48a2-901a-ccd24e9dbd34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:41.185757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd240604-e18d-48a2-901a-ccd24e9dbd34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.186388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd240604-e18d-48a2-901a-ccd24e9dbd34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.186932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd240604-e18d-48a2-901a-ccd24e9dbd34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.187772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd240604-e18d-48a2-901a-ccd24e9dbd34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.188375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd240604-e18d-48a2-901a-ccd24e9dbd34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.188908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd240604-e18d-48a2-901a-ccd24e9dbd34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.221068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fd240604-e18d-48a2-901a-ccd24e9dbd34 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050966 Aug 29 22:49:41.221659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 417/821] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:41.570755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5b90f944-6e77-4ba8-a26d-997f2ce9f4a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:41.572880 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5b90f944-6e77-4ba8-a26d-997f2ce9f4a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:41.580305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b90f944-6e77-4ba8-a26d-997f2ce9f4a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.580810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b90f944-6e77-4ba8-a26d-997f2ce9f4a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.581553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b90f944-6e77-4ba8-a26d-997f2ce9f4a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.582255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b90f944-6e77-4ba8-a26d-997f2ce9f4a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.582738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b90f944-6e77-4ba8-a26d-997f2ce9f4a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.583182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b90f944-6e77-4ba8-a26d-997f2ce9f4a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.618873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5b90f944-6e77-4ba8-a26d-997f2ce9f4a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052567 Aug 29 22:49:41.619464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 405/822] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:41.711608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bd869b99-3165-4203-a0a5-fc67b7ca5bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:41.714259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bd869b99-3165-4203-a0a5-fc67b7ca5bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:41.721806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd869b99-3165-4203-a0a5-fc67b7ca5bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.722299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd869b99-3165-4203-a0a5-fc67b7ca5bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.722737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd869b99-3165-4203-a0a5-fc67b7ca5bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.723443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd869b99-3165-4203-a0a5-fc67b7ca5bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.723896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd869b99-3165-4203-a0a5-fc67b7ca5bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.724350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd869b99-3165-4203-a0a5-fc67b7ca5bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.756707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bd869b99-3165-4203-a0a5-fc67b7ca5bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050668 Aug 29 22:49:41.757801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 418/823] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:41.873060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:41.873750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:41.880560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.881044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.881478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.882884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.883422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.883861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.953707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:41.969764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f7a867a9-8f8d-469e-bdc2-312dd8b881f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.100554 Aug 29 22:49:41.970358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 406/824] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:41 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:42.234802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1cbe7a96-cc1f-475a-8158-0b0d084afa02 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:42.236879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1cbe7a96-cc1f-475a-8158-0b0d084afa02 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:42.244111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1cbe7a96-cc1f-475a-8158-0b0d084afa02 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.244615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1cbe7a96-cc1f-475a-8158-0b0d084afa02 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.245054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1cbe7a96-cc1f-475a-8158-0b0d084afa02 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.245755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1cbe7a96-cc1f-475a-8158-0b0d084afa02 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.246205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1cbe7a96-cc1f-475a-8158-0b0d084afa02 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.246622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1cbe7a96-cc1f-475a-8158-0b0d084afa02 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.281269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1cbe7a96-cc1f-475a-8158-0b0d084afa02 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050698 Aug 29 22:49:42.282028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 419/825] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:42.633394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8336c77c-86e0-4a0e-af86-93999d5bbedd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:42.635916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8336c77c-86e0-4a0e-af86-93999d5bbedd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:42.643127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8336c77c-86e0-4a0e-af86-93999d5bbedd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.643611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8336c77c-86e0-4a0e-af86-93999d5bbedd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.644041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8336c77c-86e0-4a0e-af86-93999d5bbedd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.644766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8336c77c-86e0-4a0e-af86-93999d5bbedd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.645213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8336c77c-86e0-4a0e-af86-93999d5bbedd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.645629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8336c77c-86e0-4a0e-af86-93999d5bbedd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.681208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8336c77c-86e0-4a0e-af86-93999d5bbedd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052376 Aug 29 22:49:42.681512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 407/826] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:42.770602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2758d4a0-1c0f-4d70-9574-a4a411ff1b44 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:42.781232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2758d4a0-1c0f-4d70-9574-a4a411ff1b44 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:42.789649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2758d4a0-1c0f-4d70-9574-a4a411ff1b44 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.790187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2758d4a0-1c0f-4d70-9574-a4a411ff1b44 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.790659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2758d4a0-1c0f-4d70-9574-a4a411ff1b44 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.791528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2758d4a0-1c0f-4d70-9574-a4a411ff1b44 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.792102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2758d4a0-1c0f-4d70-9574-a4a411ff1b44 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.792595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2758d4a0-1c0f-4d70-9574-a4a411ff1b44 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.825706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2758d4a0-1c0f-4d70-9574-a4a411ff1b44 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058959 Aug 29 22:49:42.826284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 420/827] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:42.991387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:42.992010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:42.999564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.000058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.000520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.001226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.001673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.002094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.080018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:43.089008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3e03b5f1-9a95-48a8-b774-ea34650f1dae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.101661 Aug 29 22:49:43.089523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 408/828] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:42 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:43.296115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-40029f4f-5dee-46cd-a63a-eeea08fe67cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:43.298237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-40029f4f-5dee-46cd-a63a-eeea08fe67cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:43.305248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40029f4f-5dee-46cd-a63a-eeea08fe67cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.305744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40029f4f-5dee-46cd-a63a-eeea08fe67cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.306189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40029f4f-5dee-46cd-a63a-eeea08fe67cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.306992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40029f4f-5dee-46cd-a63a-eeea08fe67cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.307446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40029f4f-5dee-46cd-a63a-eeea08fe67cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.307873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40029f4f-5dee-46cd-a63a-eeea08fe67cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.310752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:43.343901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-40029f4f-5dee-46cd-a63a-eeea08fe67cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052088 Aug 29 22:49:43.344529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 421/829] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:43.693924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f3dbbb3a-bd36-4d6e-ae5e-77ff9fe5eb46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:43.696801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f3dbbb3a-bd36-4d6e-ae5e-77ff9fe5eb46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:43.704354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb3a-bd36-4d6e-ae5e-77ff9fe5eb46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.704841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb3a-bd36-4d6e-ae5e-77ff9fe5eb46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.705271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb3a-bd36-4d6e-ae5e-77ff9fe5eb46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.706338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb3a-bd36-4d6e-ae5e-77ff9fe5eb46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.706854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb3a-bd36-4d6e-ae5e-77ff9fe5eb46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.707276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb3a-bd36-4d6e-ae5e-77ff9fe5eb46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.744005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f3dbbb3a-bd36-4d6e-ae5e-77ff9fe5eb46 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053652 Aug 29 22:49:43.744756 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 409/830] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:43.838704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3d7fcdd5-75fe-4358-8e5f-2dc5c5929077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:43.841018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3d7fcdd5-75fe-4358-8e5f-2dc5c5929077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:43.843344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:43.848435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d7fcdd5-75fe-4358-8e5f-2dc5c5929077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.848960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d7fcdd5-75fe-4358-8e5f-2dc5c5929077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.851487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d7fcdd5-75fe-4358-8e5f-2dc5c5929077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.851487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d7fcdd5-75fe-4358-8e5f-2dc5c5929077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.851487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d7fcdd5-75fe-4358-8e5f-2dc5c5929077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.851487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d7fcdd5-75fe-4358-8e5f-2dc5c5929077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.887794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3d7fcdd5-75fe-4358-8e5f-2dc5c5929077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053372 Aug 29 22:49:43.891781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 422/831] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:44.110393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:44.110915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:44.118404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.118888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.119317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.120022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.120612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.121030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.199937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:44.209251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cacce778-5c04-40b2-811a-5137168481a3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.102885 Aug 29 22:49:44.209914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 410/832] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:44 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:44.358613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-131f5ded-8552-4149-a5c7-74b5126c1b08 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:44.361039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-131f5ded-8552-4149-a5c7-74b5126c1b08 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:44.368164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-131f5ded-8552-4149-a5c7-74b5126c1b08 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.368841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-131f5ded-8552-4149-a5c7-74b5126c1b08 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.369051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-131f5ded-8552-4149-a5c7-74b5126c1b08 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.369808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-131f5ded-8552-4149-a5c7-74b5126c1b08 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.370253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-131f5ded-8552-4149-a5c7-74b5126c1b08 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.370673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-131f5ded-8552-4149-a5c7-74b5126c1b08 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.411542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-131f5ded-8552-4149-a5c7-74b5126c1b08 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057704 Aug 29 22:49:44.412242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 423/833] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:44.758362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9558134c-040b-4488-83ba-c314735f8c87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:44.760696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9558134c-040b-4488-83ba-c314735f8c87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:44.767500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9558134c-040b-4488-83ba-c314735f8c87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.767996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9558134c-040b-4488-83ba-c314735f8c87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.768459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9558134c-040b-4488-83ba-c314735f8c87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.769169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9558134c-040b-4488-83ba-c314735f8c87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.769622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9558134c-040b-4488-83ba-c314735f8c87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.770049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9558134c-040b-4488-83ba-c314735f8c87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.803168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9558134c-040b-4488-83ba-c314735f8c87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049336 Aug 29 22:49:44.803776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 411/834] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:44.901770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-74853788-8648-4ca9-a76c-3699c14fff7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:44.903933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-74853788-8648-4ca9-a76c-3699c14fff7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:44.911617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74853788-8648-4ca9-a76c-3699c14fff7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.912101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74853788-8648-4ca9-a76c-3699c14fff7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.912562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74853788-8648-4ca9-a76c-3699c14fff7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.913396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74853788-8648-4ca9-a76c-3699c14fff7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.913396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74853788-8648-4ca9-a76c-3699c14fff7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.914366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74853788-8648-4ca9-a76c-3699c14fff7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.950626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-74853788-8648-4ca9-a76c-3699c14fff7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053560 Aug 29 22:49:44.959503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 424/835] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:45.232491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:45.233098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:45.239651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.240315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.240823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.242218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.242748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.243356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.313077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:45.325413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-216418a0-690b-4377-8fa8-40f270c98e71 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.096862 Aug 29 22:49:45.326527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 412/836] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:45 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:45.426811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-aa2b69d9-f713-4a08-8979-f4036c3209ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:45.430630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-aa2b69d9-f713-4a08-8979-f4036c3209ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:45.436964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2b69d9-f713-4a08-8979-f4036c3209ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.437444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2b69d9-f713-4a08-8979-f4036c3209ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.437874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2b69d9-f713-4a08-8979-f4036c3209ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.438558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2b69d9-f713-4a08-8979-f4036c3209ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.439008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2b69d9-f713-4a08-8979-f4036c3209ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.439419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2b69d9-f713-4a08-8979-f4036c3209ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.471653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-aa2b69d9-f713-4a08-8979-f4036c3209ea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049298 Aug 29 22:49:45.472276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 425/837] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:45.815279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-14217ae6-6ccd-4f74-9b8b-c2ff84e419c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:45.817460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-14217ae6-6ccd-4f74-9b8b-c2ff84e419c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:45.824885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14217ae6-6ccd-4f74-9b8b-c2ff84e419c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.825487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14217ae6-6ccd-4f74-9b8b-c2ff84e419c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.825925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14217ae6-6ccd-4f74-9b8b-c2ff84e419c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.826635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14217ae6-6ccd-4f74-9b8b-c2ff84e419c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.827087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14217ae6-6ccd-4f74-9b8b-c2ff84e419c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.827505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14217ae6-6ccd-4f74-9b8b-c2ff84e419c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.860153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-14217ae6-6ccd-4f74-9b8b-c2ff84e419c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048768 Aug 29 22:49:45.860754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 413/838] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:45.971486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5cc7b2dd-59b0-432e-8b2f-184d051bda65 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:45.973775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5cc7b2dd-59b0-432e-8b2f-184d051bda65 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:45.981310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc7b2dd-59b0-432e-8b2f-184d051bda65 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.981796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc7b2dd-59b0-432e-8b2f-184d051bda65 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.982230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc7b2dd-59b0-432e-8b2f-184d051bda65 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.982963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc7b2dd-59b0-432e-8b2f-184d051bda65 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.983428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc7b2dd-59b0-432e-8b2f-184d051bda65 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.983848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc7b2dd-59b0-432e-8b2f-184d051bda65 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.020071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5cc7b2dd-59b0-432e-8b2f-184d051bda65 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053072 Aug 29 22:49:46.020810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 426/839] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:46.347734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:46.348362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:46.356256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.356747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.357186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.357905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.358386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.358817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.431514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:46.439682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-735419a4-33ee-4e1e-baf3-422196eb1f92 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.096008 Aug 29 22:49:46.440428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 414/840] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:46 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:46.488419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9344e6db-9f8b-44e3-9831-403227a5dce2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:46.490544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9344e6db-9f8b-44e3-9831-403227a5dce2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:46.497203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9344e6db-9f8b-44e3-9831-403227a5dce2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.497691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9344e6db-9f8b-44e3-9831-403227a5dce2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.498132 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9344e6db-9f8b-44e3-9831-403227a5dce2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.498837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9344e6db-9f8b-44e3-9831-403227a5dce2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.499297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9344e6db-9f8b-44e3-9831-403227a5dce2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.499726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9344e6db-9f8b-44e3-9831-403227a5dce2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.535119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9344e6db-9f8b-44e3-9831-403227a5dce2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051007 Aug 29 22:49:46.535985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 427/841] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:46.875646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ee8174e7-21d7-4dd0-aa05-2f0f451a63f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:46.877974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ee8174e7-21d7-4dd0-aa05-2f0f451a63f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:46.880486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:46.887003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-21d7-4dd0-aa05-2f0f451a63f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.887482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-21d7-4dd0-aa05-2f0f451a63f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.887927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-21d7-4dd0-aa05-2f0f451a63f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.888681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-21d7-4dd0-aa05-2f0f451a63f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.889164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-21d7-4dd0-aa05-2f0f451a63f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.889591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee8174e7-21d7-4dd0-aa05-2f0f451a63f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.910488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:46.931324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ee8174e7-21d7-4dd0-aa05-2f0f451a63f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061339 Aug 29 22:49:46.931958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 415/842] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:47.034978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-83f37f3d-f367-4712-8d21-91b1f659de38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:47.039294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-83f37f3d-f367-4712-8d21-91b1f659de38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:47.046984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83f37f3d-f367-4712-8d21-91b1f659de38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.053978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83f37f3d-f367-4712-8d21-91b1f659de38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.053978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83f37f3d-f367-4712-8d21-91b1f659de38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.053978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83f37f3d-f367-4712-8d21-91b1f659de38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.053978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83f37f3d-f367-4712-8d21-91b1f659de38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.054468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83f37f3d-f367-4712-8d21-91b1f659de38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.092467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-83f37f3d-f367-4712-8d21-91b1f659de38 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062227 Aug 29 22:49:47.093133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 428/843] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:47.461739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:47.464918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:47.471014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.471693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.472353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.475776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.476451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.477179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.550575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fc19b2cb-eeed-4fb0-bc90-e9f8f9ad7c12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:47.553115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fc19b2cb-eeed-4fb0-bc90-e9f8f9ad7c12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:47.561391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc19b2cb-eeed-4fb0-bc90-e9f8f9ad7c12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.561886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc19b2cb-eeed-4fb0-bc90-e9f8f9ad7c12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.562317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc19b2cb-eeed-4fb0-bc90-e9f8f9ad7c12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.563039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc19b2cb-eeed-4fb0-bc90-e9f8f9ad7c12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.563701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc19b2cb-eeed-4fb0-bc90-e9f8f9ad7c12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.564126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc19b2cb-eeed-4fb0-bc90-e9f8f9ad7c12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.572496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:47.583157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5c3dae63-a6b4-4c75-8f79-116fb85e1d41 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.126073 Aug 29 22:49:47.583763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 416/844] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:47 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:47.609502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fc19b2cb-eeed-4fb0-bc90-e9f8f9ad7c12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062830 Aug 29 22:49:47.610648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 429/845] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:47.944430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-457eafa5-7da7-44cc-a993-09c82cb1fa73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:47.946657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-457eafa5-7da7-44cc-a993-09c82cb1fa73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:47.953532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457eafa5-7da7-44cc-a993-09c82cb1fa73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.954063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457eafa5-7da7-44cc-a993-09c82cb1fa73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.954501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457eafa5-7da7-44cc-a993-09c82cb1fa73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.955248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457eafa5-7da7-44cc-a993-09c82cb1fa73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.955708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457eafa5-7da7-44cc-a993-09c82cb1fa73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.956436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457eafa5-7da7-44cc-a993-09c82cb1fa73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.991024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-457eafa5-7da7-44cc-a993-09c82cb1fa73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050385 Aug 29 22:49:47.992260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 417/846] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:48.107206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-65933f34-9cba-4a42-8e5b-b70232b9e174 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:48.110444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-65933f34-9cba-4a42-8e5b-b70232b9e174 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:48.117631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65933f34-9cba-4a42-8e5b-b70232b9e174 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.118123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65933f34-9cba-4a42-8e5b-b70232b9e174 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.118563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65933f34-9cba-4a42-8e5b-b70232b9e174 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.119276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65933f34-9cba-4a42-8e5b-b70232b9e174 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.119739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65933f34-9cba-4a42-8e5b-b70232b9e174 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.120407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65933f34-9cba-4a42-8e5b-b70232b9e174 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.155174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-65933f34-9cba-4a42-8e5b-b70232b9e174 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052947 Aug 29 22:49:48.155763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 430/847] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:48.607620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:48.608536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:48.614901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.615376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.615821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.616658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.617122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.617549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.623883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f81b7841-a525-4b89-80dc-c3246d420c56 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:48.626420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f81b7841-a525-4b89-80dc-c3246d420c56 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:48.634990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f81b7841-a525-4b89-80dc-c3246d420c56 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.635493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f81b7841-a525-4b89-80dc-c3246d420c56 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.635934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f81b7841-a525-4b89-80dc-c3246d420c56 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.636709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f81b7841-a525-4b89-80dc-c3246d420c56 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.637207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f81b7841-a525-4b89-80dc-c3246d420c56 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.637630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f81b7841-a525-4b89-80dc-c3246d420c56 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.677354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f81b7841-a525-4b89-80dc-c3246d420c56 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057410 Aug 29 22:49:48.677882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 431/848] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:48.688687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:48.698977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-721853a1-214b-4cfe-a2ca-8d2faf5e98b7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.095571 Aug 29 22:49:48.699564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 418/849] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:48 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:49.006641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-335278a5-8252-424e-a77b-3ff20c53b6d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:49.010637 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-335278a5-8252-424e-a77b-3ff20c53b6d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:49.016786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-335278a5-8252-424e-a77b-3ff20c53b6d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.017292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-335278a5-8252-424e-a77b-3ff20c53b6d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.017731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-335278a5-8252-424e-a77b-3ff20c53b6d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.018437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-335278a5-8252-424e-a77b-3ff20c53b6d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.018910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-335278a5-8252-424e-a77b-3ff20c53b6d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.019389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-335278a5-8252-424e-a77b-3ff20c53b6d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.050473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-335278a5-8252-424e-a77b-3ff20c53b6d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Aug 29 22:49:49.051052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 432/850] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:49.168632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1c35d766-4c1a-4a19-9ada-04073f1c8ab2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:49.170766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1c35d766-4c1a-4a19-9ada-04073f1c8ab2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:49.178233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c35d766-4c1a-4a19-9ada-04073f1c8ab2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.179473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c35d766-4c1a-4a19-9ada-04073f1c8ab2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.179961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c35d766-4c1a-4a19-9ada-04073f1c8ab2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.180691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c35d766-4c1a-4a19-9ada-04073f1c8ab2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.181150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c35d766-4c1a-4a19-9ada-04073f1c8ab2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.183544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c35d766-4c1a-4a19-9ada-04073f1c8ab2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.214107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1c35d766-4c1a-4a19-9ada-04073f1c8ab2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049694 Aug 29 22:49:49.214690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 419/851] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:49 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:49.690309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-034fc0d4-506f-4ed2-8434-3105c85c3430 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:49.692679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-034fc0d4-506f-4ed2-8434-3105c85c3430 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:49.699432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-034fc0d4-506f-4ed2-8434-3105c85c3430 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.699920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-034fc0d4-506f-4ed2-8434-3105c85c3430 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.700392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-034fc0d4-506f-4ed2-8434-3105c85c3430 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.701237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-034fc0d4-506f-4ed2-8434-3105c85c3430 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.701785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-034fc0d4-506f-4ed2-8434-3105c85c3430 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.702560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-034fc0d4-506f-4ed2-8434-3105c85c3430 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.720409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:49.721096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:49.729502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.729990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.730426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.731328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:49.731939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:49.732392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.736970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-034fc0d4-506f-4ed2-8434-3105c85c3430 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050587 Aug 29 22:49:49.737560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 433/852] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:49.799909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:49.808841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5f859327-83fc-40e3-b1d6-c7919488d16d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092494 Aug 29 22:49:49.809441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 420/853] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:49 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:50.066782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c48f5387-2609-439c-80bb-5170eb995639 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:50.068955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c48f5387-2609-439c-80bb-5170eb995639 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:50.076230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c48f5387-2609-439c-80bb-5170eb995639 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.076768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c48f5387-2609-439c-80bb-5170eb995639 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.077214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c48f5387-2609-439c-80bb-5170eb995639 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.077918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c48f5387-2609-439c-80bb-5170eb995639 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.078373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c48f5387-2609-439c-80bb-5170eb995639 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.078792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c48f5387-2609-439c-80bb-5170eb995639 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.113148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c48f5387-2609-439c-80bb-5170eb995639 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050423 Aug 29 22:49:50.113727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 434/854] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:50.226872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-96d62c3f-63dc-43b3-a1b2-fa9aba78e7fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:50.229055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-96d62c3f-63dc-43b3-a1b2-fa9aba78e7fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:50.235803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96d62c3f-63dc-43b3-a1b2-fa9aba78e7fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.236322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96d62c3f-63dc-43b3-a1b2-fa9aba78e7fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.236759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96d62c3f-63dc-43b3-a1b2-fa9aba78e7fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.237457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96d62c3f-63dc-43b3-a1b2-fa9aba78e7fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.237909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96d62c3f-63dc-43b3-a1b2-fa9aba78e7fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.238333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96d62c3f-63dc-43b3-a1b2-fa9aba78e7fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.272097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-96d62c3f-63dc-43b3-a1b2-fa9aba78e7fb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049258 Aug 29 22:49:50.273701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 421/855] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:50.750670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-71861a05-6cd1-43b6-8084-cbd13a94e0d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:50.752840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-71861a05-6cd1-43b6-8084-cbd13a94e0d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:50.760309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71861a05-6cd1-43b6-8084-cbd13a94e0d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.760790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71861a05-6cd1-43b6-8084-cbd13a94e0d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.761250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71861a05-6cd1-43b6-8084-cbd13a94e0d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.761953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71861a05-6cd1-43b6-8084-cbd13a94e0d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.762405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71861a05-6cd1-43b6-8084-cbd13a94e0d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.762827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71861a05-6cd1-43b6-8084-cbd13a94e0d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.794319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-71861a05-6cd1-43b6-8084-cbd13a94e0d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048037 Aug 29 22:49:50.794906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 435/856] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:50.829861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:50.830499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:50.838028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.838515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.838956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.839654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.840110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.840555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.907710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:50.916814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cb52156f-0e32-4f5d-bb3a-093a52c16ccd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090809 Aug 29 22:49:50.917400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 422/857] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:50 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:51.126071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2bf4a0d9-91a1-4e98-8677-8b63b468710e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:51.128317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2bf4a0d9-91a1-4e98-8677-8b63b468710e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:51.135886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf4a0d9-91a1-4e98-8677-8b63b468710e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.136415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf4a0d9-91a1-4e98-8677-8b63b468710e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.136851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf4a0d9-91a1-4e98-8677-8b63b468710e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.137565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf4a0d9-91a1-4e98-8677-8b63b468710e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.138018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf4a0d9-91a1-4e98-8677-8b63b468710e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.138474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf4a0d9-91a1-4e98-8677-8b63b468710e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.172435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2bf4a0d9-91a1-4e98-8677-8b63b468710e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050541 Aug 29 22:49:51.173020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 436/858] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:51.285321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-26bd7e7e-34e0-4109-abc3-ada40e08871f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:51.287588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-26bd7e7e-34e0-4109-abc3-ada40e08871f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:51.294627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26bd7e7e-34e0-4109-abc3-ada40e08871f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.295112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26bd7e7e-34e0-4109-abc3-ada40e08871f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.295539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26bd7e7e-34e0-4109-abc3-ada40e08871f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.296296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26bd7e7e-34e0-4109-abc3-ada40e08871f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.298698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26bd7e7e-34e0-4109-abc3-ada40e08871f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.298698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26bd7e7e-34e0-4109-abc3-ada40e08871f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.331957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-26bd7e7e-34e0-4109-abc3-ada40e08871f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050518 Aug 29 22:49:51.332670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 423/859] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:51.807737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e0b08427-4267-47a0-9cfa-80f2da2230cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:51.809979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e0b08427-4267-47a0-9cfa-80f2da2230cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:51.816634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b08427-4267-47a0-9cfa-80f2da2230cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.817202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b08427-4267-47a0-9cfa-80f2da2230cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.817789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b08427-4267-47a0-9cfa-80f2da2230cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.818485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b08427-4267-47a0-9cfa-80f2da2230cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.818936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b08427-4267-47a0-9cfa-80f2da2230cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.820042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0b08427-4267-47a0-9cfa-80f2da2230cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.847531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:51.852553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e0b08427-4267-47a0-9cfa-80f2da2230cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049399 Aug 29 22:49:51.853185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 437/860] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:51.950208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:51.950809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:51.957504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.957908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.958335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.959019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.959465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.959932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.023510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:52.031946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ce481123-d57f-40ca-91cb-1e52593f7c03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085769 Aug 29 22:49:52.032574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 424/861] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:51 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:52.186109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-82ac2a9c-41f3-484d-adcd-01bdcbf83665 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:52.188266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-82ac2a9c-41f3-484d-adcd-01bdcbf83665 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:52.194620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82ac2a9c-41f3-484d-adcd-01bdcbf83665 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.195101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82ac2a9c-41f3-484d-adcd-01bdcbf83665 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.195532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82ac2a9c-41f3-484d-adcd-01bdcbf83665 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.196255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82ac2a9c-41f3-484d-adcd-01bdcbf83665 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.196705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82ac2a9c-41f3-484d-adcd-01bdcbf83665 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.197120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82ac2a9c-41f3-484d-adcd-01bdcbf83665 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.229647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-82ac2a9c-41f3-484d-adcd-01bdcbf83665 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047711 Aug 29 22:49:52.230138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 438/862] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:52.346021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-63548c32-0a86-4e48-a689-4cc592b4cea5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:52.348285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-63548c32-0a86-4e48-a689-4cc592b4cea5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:52.357287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63548c32-0a86-4e48-a689-4cc592b4cea5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.357793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63548c32-0a86-4e48-a689-4cc592b4cea5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.358218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63548c32-0a86-4e48-a689-4cc592b4cea5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.358932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63548c32-0a86-4e48-a689-4cc592b4cea5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.359383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63548c32-0a86-4e48-a689-4cc592b4cea5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.359811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63548c32-0a86-4e48-a689-4cc592b4cea5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.394077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-63548c32-0a86-4e48-a689-4cc592b4cea5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052570 Aug 29 22:49:52.394664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 425/863] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:52.866678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0dd97134-6f7e-4641-a9a1-5a199661e5d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:52.869360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0dd97134-6f7e-4641-a9a1-5a199661e5d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:52.876249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dd97134-6f7e-4641-a9a1-5a199661e5d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.876899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dd97134-6f7e-4641-a9a1-5a199661e5d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.877386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dd97134-6f7e-4641-a9a1-5a199661e5d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.878293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dd97134-6f7e-4641-a9a1-5a199661e5d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.878837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dd97134-6f7e-4641-a9a1-5a199661e5d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.879263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dd97134-6f7e-4641-a9a1-5a199661e5d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.915219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0dd97134-6f7e-4641-a9a1-5a199661e5d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053406 Aug 29 22:49:52.915799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 439/864] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:53.053179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:53.053863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:53.060503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.060993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.061433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.062133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.062594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.063016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.127489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:53.136313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b7e6f98f-f5cf-41b9-aad1-725a97cd64d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086882 Aug 29 22:49:53.136899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 426/865] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:53 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:53.242700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0761380f-8737-4b10-8d6d-210fc04daa6e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:53.244892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0761380f-8737-4b10-8d6d-210fc04daa6e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:53.251022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0761380f-8737-4b10-8d6d-210fc04daa6e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.251534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0761380f-8737-4b10-8d6d-210fc04daa6e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.251977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0761380f-8737-4b10-8d6d-210fc04daa6e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.252702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0761380f-8737-4b10-8d6d-210fc04daa6e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.253157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0761380f-8737-4b10-8d6d-210fc04daa6e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.253698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0761380f-8737-4b10-8d6d-210fc04daa6e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.285527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0761380f-8737-4b10-8d6d-210fc04daa6e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Aug 29 22:49:53.286100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 440/866] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:53 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:53.408044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0522d816-9554-480d-b090-62d6a5fc3975 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:53.410148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0522d816-9554-480d-b090-62d6a5fc3975 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:53.417193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0522d816-9554-480d-b090-62d6a5fc3975 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.417689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0522d816-9554-480d-b090-62d6a5fc3975 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.418129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0522d816-9554-480d-b090-62d6a5fc3975 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.418843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0522d816-9554-480d-b090-62d6a5fc3975 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.419294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0522d816-9554-480d-b090-62d6a5fc3975 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.419718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0522d816-9554-480d-b090-62d6a5fc3975 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.452500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0522d816-9554-480d-b090-62d6a5fc3975 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048334 Aug 29 22:49:53.453408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 427/867] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:53.927324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eeb7fddb-ba7c-4274-a7a3-56139105ee0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:53.929630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eeb7fddb-ba7c-4274-a7a3-56139105ee0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:53.936431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eeb7fddb-ba7c-4274-a7a3-56139105ee0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.936918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eeb7fddb-ba7c-4274-a7a3-56139105ee0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.937349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eeb7fddb-ba7c-4274-a7a3-56139105ee0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.938084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eeb7fddb-ba7c-4274-a7a3-56139105ee0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.938537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eeb7fddb-ba7c-4274-a7a3-56139105ee0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.938960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eeb7fddb-ba7c-4274-a7a3-56139105ee0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.974938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eeb7fddb-ba7c-4274-a7a3-56139105ee0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051440 Aug 29 22:49:53.975482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 441/868] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:54.157538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:54.158172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:54.165500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.165742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.166046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.166781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.167237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.167662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.234305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:54.243386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-edb5d5b1-45c3-4107-893f-fbc2f92fd030 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089887 Aug 29 22:49:54.244004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 428/869] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:54 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:54.298644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0736f64d-9377-431b-b82f-c78d83c9147b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:54.300933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0736f64d-9377-431b-b82f-c78d83c9147b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:54.308108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736f64d-9377-431b-b82f-c78d83c9147b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.308546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736f64d-9377-431b-b82f-c78d83c9147b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.308977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736f64d-9377-431b-b82f-c78d83c9147b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.309685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736f64d-9377-431b-b82f-c78d83c9147b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.310135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736f64d-9377-431b-b82f-c78d83c9147b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.310556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736f64d-9377-431b-b82f-c78d83c9147b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.353808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0736f64d-9377-431b-b82f-c78d83c9147b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059287 Aug 29 22:49:54.354392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 442/870] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:54.467194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-755c14a3-2423-4ab5-800d-734f97511477 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:54.469412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-755c14a3-2423-4ab5-800d-734f97511477 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:54.476079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-755c14a3-2423-4ab5-800d-734f97511477 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.476996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-755c14a3-2423-4ab5-800d-734f97511477 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.477179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-755c14a3-2423-4ab5-800d-734f97511477 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-755c14a3-2423-4ab5-800d-734f97511477 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:54.478656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-755c14a3-2423-4ab5-800d-734f97511477 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:54.478780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-755c14a3-2423-4ab5-800d-734f97511477 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.511255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-755c14a3-2423-4ab5-800d-734f97511477 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048218 Aug 29 22:49:54.511761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 429/871] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:54.995271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1d79c980-e3cf-440a-8e7c-bff46c0b8f65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:54.997514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1d79c980-e3cf-440a-8e7c-bff46c0b8f65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:55.004245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d79c980-e3cf-440a-8e7c-bff46c0b8f65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.004725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d79c980-e3cf-440a-8e7c-bff46c0b8f65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.005151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d79c980-e3cf-440a-8e7c-bff46c0b8f65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.005884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d79c980-e3cf-440a-8e7c-bff46c0b8f65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.006332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d79c980-e3cf-440a-8e7c-bff46c0b8f65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.006785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d79c980-e3cf-440a-8e7c-bff46c0b8f65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.039185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1d79c980-e3cf-440a-8e7c-bff46c0b8f65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048795 Aug 29 22:49:55.039775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 443/872] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:55.266611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:55.267307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:55.274600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.275089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.275542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.276382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.276892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.277346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.346525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:55.355811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-40b54f55-ddce-44e4-828e-08a21d3ba187 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093027 Aug 29 22:49:55.356446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 430/873] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:55 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:55.367310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a3540331-2284-41cc-a993-8a9bdd111d22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:55.370230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a3540331-2284-41cc-a993-8a9bdd111d22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:55.377072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3540331-2284-41cc-a993-8a9bdd111d22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.377564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3540331-2284-41cc-a993-8a9bdd111d22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.378004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3540331-2284-41cc-a993-8a9bdd111d22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.378711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3540331-2284-41cc-a993-8a9bdd111d22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.379167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3540331-2284-41cc-a993-8a9bdd111d22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.379625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3540331-2284-41cc-a993-8a9bdd111d22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.413728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a3540331-2284-41cc-a993-8a9bdd111d22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050769 Aug 29 22:49:55.414310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 444/874] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:55.524263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1610cdfb-0060-4295-989c-f149554b319e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:55.526354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1610cdfb-0060-4295-989c-f149554b319e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:55.532869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1610cdfb-0060-4295-989c-f149554b319e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.533360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1610cdfb-0060-4295-989c-f149554b319e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.533823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1610cdfb-0060-4295-989c-f149554b319e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.534590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1610cdfb-0060-4295-989c-f149554b319e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.535045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1610cdfb-0060-4295-989c-f149554b319e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.535474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1610cdfb-0060-4295-989c-f149554b319e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.568869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1610cdfb-0060-4295-989c-f149554b319e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049312 Aug 29 22:49:55.569618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 431/875] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:56.052533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7b3626f2-47e0-40cc-a737-2ad8a0706148 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:56.055017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7b3626f2-47e0-40cc-a737-2ad8a0706148 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:56.062040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3626f2-47e0-40cc-a737-2ad8a0706148 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.062523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3626f2-47e0-40cc-a737-2ad8a0706148 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.062953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3626f2-47e0-40cc-a737-2ad8a0706148 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.063652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3626f2-47e0-40cc-a737-2ad8a0706148 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.064100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3626f2-47e0-40cc-a737-2ad8a0706148 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.064554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b3626f2-47e0-40cc-a737-2ad8a0706148 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.097937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7b3626f2-47e0-40cc-a737-2ad8a0706148 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049308 Aug 29 22:49:56.098524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 445/876] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:56.378835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:56.379466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:56.386989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.387465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.387902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.388632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.389086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.389504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.393935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:56.427417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-30706ee4-3c0a-4bb8-86aa-6c030729be20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:56.431198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-30706ee4-3c0a-4bb8-86aa-6c030729be20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:56.438005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30706ee4-3c0a-4bb8-86aa-6c030729be20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.438502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30706ee4-3c0a-4bb8-86aa-6c030729be20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.438942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30706ee4-3c0a-4bb8-86aa-6c030729be20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.439660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30706ee4-3c0a-4bb8-86aa-6c030729be20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.440129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30706ee4-3c0a-4bb8-86aa-6c030729be20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.440575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30706ee4-3c0a-4bb8-86aa-6c030729be20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.458827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:56.467627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b345af53-c748-48a8-bac2-b590933225c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092576 Aug 29 22:49:56.468257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 432/877] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:56 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:56.474768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-30706ee4-3c0a-4bb8-86aa-6c030729be20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051749 Aug 29 22:49:56.475512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 446/878] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:56.583036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3202c115-67e0-487a-a421-52a6e120e22c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:56.585449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3202c115-67e0-487a-a421-52a6e120e22c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:56.592325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3202c115-67e0-487a-a421-52a6e120e22c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.592814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3202c115-67e0-487a-a421-52a6e120e22c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.593326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3202c115-67e0-487a-a421-52a6e120e22c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.594025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3202c115-67e0-487a-a421-52a6e120e22c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.594473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3202c115-67e0-487a-a421-52a6e120e22c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.594889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3202c115-67e0-487a-a421-52a6e120e22c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.630743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3202c115-67e0-487a-a421-52a6e120e22c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051973 Aug 29 22:49:56.631343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 433/879] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:57.110913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-464206c8-55ac-46c6-a503-743c1e5c5038 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:57.113235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-464206c8-55ac-46c6-a503-743c1e5c5038 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:57.121527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-464206c8-55ac-46c6-a503-743c1e5c5038 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.122065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-464206c8-55ac-46c6-a503-743c1e5c5038 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.122501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-464206c8-55ac-46c6-a503-743c1e5c5038 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.123211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-464206c8-55ac-46c6-a503-743c1e5c5038 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.123863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-464206c8-55ac-46c6-a503-743c1e5c5038 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.124321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-464206c8-55ac-46c6-a503-743c1e5c5038 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.157775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-464206c8-55ac-46c6-a503-743c1e5c5038 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051268 Aug 29 22:49:57.158370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 447/880] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:57.487989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d10ada52-c5c4-40cd-8144-52f2b70e11af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:57.488304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:57.488725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:57.490288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d10ada52-c5c4-40cd-8144-52f2b70e11af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:57.496120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.497449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.497449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.497753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.497931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d10ada52-c5c4-40cd-8144-52f2b70e11af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.498206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.498356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d10ada52-c5c4-40cd-8144-52f2b70e11af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.498631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.498774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d10ada52-c5c4-40cd-8144-52f2b70e11af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.499406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d10ada52-c5c4-40cd-8144-52f2b70e11af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.499859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d10ada52-c5c4-40cd-8144-52f2b70e11af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.500322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d10ada52-c5c4-40cd-8144-52f2b70e11af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.533236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d10ada52-c5c4-40cd-8144-52f2b70e11af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049799 Aug 29 22:49:57.533826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 434/881] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:57.569035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:57.577997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d39ccb34-0716-4d01-8829-b008fbecbe69 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093678 Aug 29 22:49:57.578592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 448/882] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:57 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:57.644025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-921db81a-d537-42c9-9e93-bb948bd01473 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:57.646180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-921db81a-d537-42c9-9e93-bb948bd01473 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:57.653322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-921db81a-d537-42c9-9e93-bb948bd01473 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.654066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-921db81a-d537-42c9-9e93-bb948bd01473 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.654542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-921db81a-d537-42c9-9e93-bb948bd01473 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.655246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-921db81a-d537-42c9-9e93-bb948bd01473 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.655701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-921db81a-d537-42c9-9e93-bb948bd01473 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.656127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-921db81a-d537-42c9-9e93-bb948bd01473 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.687640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-921db81a-d537-42c9-9e93-bb948bd01473 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047765 Aug 29 22:49:57.688295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 435/883] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:58.173891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-08ae9540-b961-468b-88a0-af16ecd03c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:58.175925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-08ae9540-b961-468b-88a0-af16ecd03c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:58.183159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08ae9540-b961-468b-88a0-af16ecd03c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.183815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08ae9540-b961-468b-88a0-af16ecd03c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.184291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08ae9540-b961-468b-88a0-af16ecd03c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.184991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08ae9540-b961-468b-88a0-af16ecd03c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.185451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08ae9540-b961-468b-88a0-af16ecd03c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.185868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08ae9540-b961-468b-88a0-af16ecd03c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.219373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-08ae9540-b961-468b-88a0-af16ecd03c79 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049455 Aug 29 22:49:58.219977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 449/884] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:58.547374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6ab75245-2c76-4295-ba93-44460fd85392 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:58.549873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6ab75245-2c76-4295-ba93-44460fd85392 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:58.558391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab75245-2c76-4295-ba93-44460fd85392 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.558391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab75245-2c76-4295-ba93-44460fd85392 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.558391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab75245-2c76-4295-ba93-44460fd85392 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.559082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab75245-2c76-4295-ba93-44460fd85392 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.559536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab75245-2c76-4295-ba93-44460fd85392 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.559953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ab75245-2c76-4295-ba93-44460fd85392 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.593074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6ab75245-2c76-4295-ba93-44460fd85392 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049776 Aug 29 22:49:58.593663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 436/885] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:58.599110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:58.599718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:58.607561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.608099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.608557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.609268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.609727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.610155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.682055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:58.690431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3ef62ec4-934c-4a65-9f22-1fd92c039491 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.095098 Aug 29 22:49:58.691027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 450/886] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:58 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:58.702890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1f968d68-7f3a-49e5-b90f-10e13e9f7297 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:58.705224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1f968d68-7f3a-49e5-b90f-10e13e9f7297 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:58.712112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f968d68-7f3a-49e5-b90f-10e13e9f7297 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.712639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f968d68-7f3a-49e5-b90f-10e13e9f7297 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.713077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f968d68-7f3a-49e5-b90f-10e13e9f7297 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.713781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f968d68-7f3a-49e5-b90f-10e13e9f7297 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.714236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f968d68-7f3a-49e5-b90f-10e13e9f7297 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.714659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f968d68-7f3a-49e5-b90f-10e13e9f7297 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.747867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1f968d68-7f3a-49e5-b90f-10e13e9f7297 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049350 Aug 29 22:49:58.748477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 437/887] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:59.232935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1fd4af97-926c-4ca5-9426-36271e4113f6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:59.234984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1fd4af97-926c-4ca5-9426-36271e4113f6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:59.242285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fd4af97-926c-4ca5-9426-36271e4113f6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.242785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fd4af97-926c-4ca5-9426-36271e4113f6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.243222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fd4af97-926c-4ca5-9426-36271e4113f6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.243931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fd4af97-926c-4ca5-9426-36271e4113f6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.244433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fd4af97-926c-4ca5-9426-36271e4113f6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.244917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fd4af97-926c-4ca5-9426-36271e4113f6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.280671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1fd4af97-926c-4ca5-9426-36271e4113f6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051964 Aug 29 22:49:59.281255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 451/888] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:49:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:49:59.606297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3a740bc5-24bc-44bf-afd0-6f954cb123ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:59.608398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3a740bc5-24bc-44bf-afd0-6f954cb123ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:59.614944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a740bc5-24bc-44bf-afd0-6f954cb123ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.615424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a740bc5-24bc-44bf-afd0-6f954cb123ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.615856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a740bc5-24bc-44bf-afd0-6f954cb123ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.617075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a740bc5-24bc-44bf-afd0-6f954cb123ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.617533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a740bc5-24bc-44bf-afd0-6f954cb123ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.617959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a740bc5-24bc-44bf-afd0-6f954cb123ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.651129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3a740bc5-24bc-44bf-afd0-6f954cb123ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048889 Aug 29 22:49:59.651722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 438/889] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:59.711270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:59.712011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:59.718120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.718606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.719052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.719750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.720247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.720682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.760368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1f611991-e190-4a68-8fd9-e1c34f937522 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:59.762664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1f611991-e190-4a68-8fd9-e1c34f937522 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:59.768794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f611991-e190-4a68-8fd9-e1c34f937522 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.769276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f611991-e190-4a68-8fd9-e1c34f937522 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.769702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f611991-e190-4a68-8fd9-e1c34f937522 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.770408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f611991-e190-4a68-8fd9-e1c34f937522 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:59.770833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f611991-e190-4a68-8fd9-e1c34f937522 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:59.771246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f611991-e190-4a68-8fd9-e1c34f937522 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:59.787014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:59.795742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c13849b8-7cc2-4a8f-9e56-b44e6a1b1017 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088524 Aug 29 22:49:59.796345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 452/890] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:59 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:59.811417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1f611991-e190-4a68-8fd9-e1c34f937522 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055037 Aug 29 22:49:59.812008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 439/891] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:00.293932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-43b52fff-f51d-432b-a1d8-174e8ad5143c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:00.296051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-43b52fff-f51d-432b-a1d8-174e8ad5143c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:00.302855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43b52fff-f51d-432b-a1d8-174e8ad5143c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.303343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43b52fff-f51d-432b-a1d8-174e8ad5143c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.304578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43b52fff-f51d-432b-a1d8-174e8ad5143c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.305474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43b52fff-f51d-432b-a1d8-174e8ad5143c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.305937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43b52fff-f51d-432b-a1d8-174e8ad5143c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.306372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43b52fff-f51d-432b-a1d8-174e8ad5143c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.340298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-43b52fff-f51d-432b-a1d8-174e8ad5143c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050421 Aug 29 22:50:00.340904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 453/892] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:00.665295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-42ea8a74-4e40-42f3-a075-c975f25f4281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:00.666923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-42ea8a74-4e40-42f3-a075-c975f25f4281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:00.673720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-42ea8a74-4e40-42f3-a075-c975f25f4281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.674247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-42ea8a74-4e40-42f3-a075-c975f25f4281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.674735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-42ea8a74-4e40-42f3-a075-c975f25f4281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.675867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-42ea8a74-4e40-42f3-a075-c975f25f4281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.676419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-42ea8a74-4e40-42f3-a075-c975f25f4281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.676942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-42ea8a74-4e40-42f3-a075-c975f25f4281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.711637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-42ea8a74-4e40-42f3-a075-c975f25f4281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052090 Aug 29 22:50:00.712306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 440/893] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:00.818870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:00.820064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:00.823615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-95570ebb-60ed-45c7-8ded-bf542999603d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:00.825833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-95570ebb-60ed-45c7-8ded-bf542999603d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:00.826567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.827062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.827504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.828288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.828756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.829188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.832730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95570ebb-60ed-45c7-8ded-bf542999603d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.833212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95570ebb-60ed-45c7-8ded-bf542999603d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.833644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95570ebb-60ed-45c7-8ded-bf542999603d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.834340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95570ebb-60ed-45c7-8ded-bf542999603d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.834825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95570ebb-60ed-45c7-8ded-bf542999603d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.835241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95570ebb-60ed-45c7-8ded-bf542999603d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.848870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:00.869831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-95570ebb-60ed-45c7-8ded-bf542999603d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050890 Aug 29 22:50:00.870428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 441/894] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:00.909654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:00.922010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-57626648-9615-455c-8cbf-0f4a7b833ce1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.106710 Aug 29 22:50:00.922807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 454/895] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:00 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:01.358689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-06cc2ad8-8532-40a6-8ab0-04f2d44a9c38 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:01.362273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-06cc2ad8-8532-40a6-8ab0-04f2d44a9c38 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:01.373570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06cc2ad8-8532-40a6-8ab0-04f2d44a9c38 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.374431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06cc2ad8-8532-40a6-8ab0-04f2d44a9c38 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.375198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06cc2ad8-8532-40a6-8ab0-04f2d44a9c38 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.376416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06cc2ad8-8532-40a6-8ab0-04f2d44a9c38 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.377214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06cc2ad8-8532-40a6-8ab0-04f2d44a9c38 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.377983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06cc2ad8-8532-40a6-8ab0-04f2d44a9c38 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.438902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-06cc2ad8-8532-40a6-8ab0-04f2d44a9c38 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088788 Aug 29 22:50:01.439532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 442/896] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:01.733181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b0748be3-b5eb-4d8d-9c80-11bcf71df1c3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:01.733181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b0748be3-b5eb-4d8d-9c80-11bcf71df1c3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:01.741582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0748be3-b5eb-4d8d-9c80-11bcf71df1c3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.742227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0748be3-b5eb-4d8d-9c80-11bcf71df1c3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.742790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0748be3-b5eb-4d8d-9c80-11bcf71df1c3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.743627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0748be3-b5eb-4d8d-9c80-11bcf71df1c3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.744426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0748be3-b5eb-4d8d-9c80-11bcf71df1c3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.745073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0748be3-b5eb-4d8d-9c80-11bcf71df1c3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.784028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b0748be3-b5eb-4d8d-9c80-11bcf71df1c3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060140 Aug 29 22:50:01.785113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 455/897] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:01.884152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d74d34b7-62e7-4146-8a96-09844d208d07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:01.886476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d74d34b7-62e7-4146-8a96-09844d208d07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:01.894685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d74d34b7-62e7-4146-8a96-09844d208d07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.895304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d74d34b7-62e7-4146-8a96-09844d208d07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.895690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d74d34b7-62e7-4146-8a96-09844d208d07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.896619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d74d34b7-62e7-4146-8a96-09844d208d07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.897551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d74d34b7-62e7-4146-8a96-09844d208d07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.898075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d74d34b7-62e7-4146-8a96-09844d208d07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.949179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:01.950272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:01.950873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d74d34b7-62e7-4146-8a96-09844d208d07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071579 Aug 29 22:50:01.951483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 443/898] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:01.962019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.962896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.963685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:01.964985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:01.965872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:01.966647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:02.061046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:02.075567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3d5d91f4-fd20-4d9c-89e3-a869f7895a11 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.134730 Aug 29 22:50:02.076588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 456/899] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:01 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:02.454966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6bc43b72-b6d5-4ac8-8ca0-39b322aa62bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:02.458489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6bc43b72-b6d5-4ac8-8ca0-39b322aa62bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:02.467994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bc43b72-b6d5-4ac8-8ca0-39b322aa62bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:02.468963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bc43b72-b6d5-4ac8-8ca0-39b322aa62bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:02.470740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bc43b72-b6d5-4ac8-8ca0-39b322aa62bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:02.470740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bc43b72-b6d5-4ac8-8ca0-39b322aa62bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:02.472283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bc43b72-b6d5-4ac8-8ca0-39b322aa62bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:02.472754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bc43b72-b6d5-4ac8-8ca0-39b322aa62bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:02.527019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6bc43b72-b6d5-4ac8-8ca0-39b322aa62bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078418 Aug 29 22:50:02.527632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 444/900] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:02.804479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-233b1fa9-737c-4a55-9e9b-9887b888b51b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:02.808356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-233b1fa9-737c-4a55-9e9b-9887b888b51b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:02.820716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233b1fa9-737c-4a55-9e9b-9887b888b51b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:02.821599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233b1fa9-737c-4a55-9e9b-9887b888b51b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:02.822559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233b1fa9-737c-4a55-9e9b-9887b888b51b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:02.823758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233b1fa9-737c-4a55-9e9b-9887b888b51b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:02.824699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233b1fa9-737c-4a55-9e9b-9887b888b51b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:02.825500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233b1fa9-737c-4a55-9e9b-9887b888b51b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:02.877354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-233b1fa9-737c-4a55-9e9b-9887b888b51b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080822 Aug 29 22:50:02.878250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 457/901] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:02.965706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-63f796f6-6b1d-4553-afc3-c51fc1c55efb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:02.968678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-63f796f6-6b1d-4553-afc3-c51fc1c55efb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:02.976915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63f796f6-6b1d-4553-afc3-c51fc1c55efb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:02.977715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63f796f6-6b1d-4553-afc3-c51fc1c55efb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:02.978355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63f796f6-6b1d-4553-afc3-c51fc1c55efb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:02.979239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63f796f6-6b1d-4553-afc3-c51fc1c55efb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:02.979865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63f796f6-6b1d-4553-afc3-c51fc1c55efb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:02.980468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63f796f6-6b1d-4553-afc3-c51fc1c55efb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:03.027615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-63f796f6-6b1d-4553-afc3-c51fc1c55efb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067543 Aug 29 22:50:03.028989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 445/902] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:03.114825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:03.116580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:03.128804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:03.129672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:03.130448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:03.132330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:03.133427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:03.134192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:03.235818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:03.250344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3e766462-9f11-4598-af96-2c1f1eaf626d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.142101 Aug 29 22:50:03.251280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 458/903] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:03 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:03.543673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3430f7be-6ded-4493-87c4-2f16362a2fad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:03.547143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3430f7be-6ded-4493-87c4-2f16362a2fad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:03.558167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3430f7be-6ded-4493-87c4-2f16362a2fad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:03.559027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3430f7be-6ded-4493-87c4-2f16362a2fad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:03.559811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3430f7be-6ded-4493-87c4-2f16362a2fad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:03.561089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3430f7be-6ded-4493-87c4-2f16362a2fad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:03.561856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3430f7be-6ded-4493-87c4-2f16362a2fad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:03.562449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3430f7be-6ded-4493-87c4-2f16362a2fad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:03.621263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3430f7be-6ded-4493-87c4-2f16362a2fad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082850 Aug 29 22:50:03.621263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 446/904] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:03.897205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-989743ab-2c41-485f-97b8-1b85fe49edf2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:03.901161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-989743ab-2c41-485f-97b8-1b85fe49edf2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:03.914177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-989743ab-2c41-485f-97b8-1b85fe49edf2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:03.915073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-989743ab-2c41-485f-97b8-1b85fe49edf2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:03.915878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-989743ab-2c41-485f-97b8-1b85fe49edf2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:03.917290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-989743ab-2c41-485f-97b8-1b85fe49edf2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:03.918067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-989743ab-2c41-485f-97b8-1b85fe49edf2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:03.918584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-989743ab-2c41-485f-97b8-1b85fe49edf2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:03.972377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-989743ab-2c41-485f-97b8-1b85fe49edf2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081857 Aug 29 22:50:03.973390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 459/905] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:04.043974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cc740da4-2cee-4e9d-a9ae-d07f8db1ee88 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:04.046400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cc740da4-2cee-4e9d-a9ae-d07f8db1ee88 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:04.054231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc740da4-2cee-4e9d-a9ae-d07f8db1ee88 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:04.054827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc740da4-2cee-4e9d-a9ae-d07f8db1ee88 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:04.055794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc740da4-2cee-4e9d-a9ae-d07f8db1ee88 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:04.056173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc740da4-2cee-4e9d-a9ae-d07f8db1ee88 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:04.056755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc740da4-2cee-4e9d-a9ae-d07f8db1ee88 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:04.057240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc740da4-2cee-4e9d-a9ae-d07f8db1ee88 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:04.092691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cc740da4-2cee-4e9d-a9ae-d07f8db1ee88 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053142 Aug 29 22:50:04.093408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 447/906] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:04.286358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:04.287269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:04.297349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:04.298134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:04.298895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:04.300175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:04.301024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:04.301794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:04.388686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:04.398634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-87592b8c-a393-4bc1-a002-a5bf63508da7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.118396 Aug 29 22:50:04.399225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 460/907] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:04 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:04.634742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a5e3ed9a-4091-4312-8156-4f3b7293617f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:04.637142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a5e3ed9a-4091-4312-8156-4f3b7293617f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:04.645101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5e3ed9a-4091-4312-8156-4f3b7293617f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:04.645875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5e3ed9a-4091-4312-8156-4f3b7293617f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:04.646367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5e3ed9a-4091-4312-8156-4f3b7293617f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:04.647992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5e3ed9a-4091-4312-8156-4f3b7293617f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:04.648671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5e3ed9a-4091-4312-8156-4f3b7293617f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:04.649185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5e3ed9a-4091-4312-8156-4f3b7293617f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:04.697325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:04.707145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a5e3ed9a-4091-4312-8156-4f3b7293617f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077025 Aug 29 22:50:04.707968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 448/908] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:04.987720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dca7853e-ef8a-4c62-9777-476a5904affd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:04.990104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dca7853e-ef8a-4c62-9777-476a5904affd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:05.000915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dca7853e-ef8a-4c62-9777-476a5904affd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:05.001859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dca7853e-ef8a-4c62-9777-476a5904affd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:05.002619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dca7853e-ef8a-4c62-9777-476a5904affd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:05.003736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dca7853e-ef8a-4c62-9777-476a5904affd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:05.004606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dca7853e-ef8a-4c62-9777-476a5904affd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:05.005381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dca7853e-ef8a-4c62-9777-476a5904affd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:05.044929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dca7853e-ef8a-4c62-9777-476a5904affd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061543 Aug 29 22:50:05.045586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 461/909] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:05.110486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-45fa93df-dc3e-4c44-8e69-6e21db11e645 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:05.113846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-45fa93df-dc3e-4c44-8e69-6e21db11e645 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:05.122863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fa93df-dc3e-4c44-8e69-6e21db11e645 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:05.123403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fa93df-dc3e-4c44-8e69-6e21db11e645 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:05.123878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fa93df-dc3e-4c44-8e69-6e21db11e645 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:05.124699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fa93df-dc3e-4c44-8e69-6e21db11e645 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:05.125193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fa93df-dc3e-4c44-8e69-6e21db11e645 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:05.125656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fa93df-dc3e-4c44-8e69-6e21db11e645 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:05.159348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-45fa93df-dc3e-4c44-8e69-6e21db11e645 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056791 Aug 29 22:50:05.160029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 449/910] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:05.430441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:05.431185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:05.438090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:05.438602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:05.439202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:05.440008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:05.440542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:05.441023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:05.517280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:05.528801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3347d259-c1cb-4800-a417-d75849f35ffd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.102645 Aug 29 22:50:05.529402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 462/911] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:05 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:05.722878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-803a8c5d-c50b-4863-9714-dbc054ba4cfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:05.725075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-803a8c5d-c50b-4863-9714-dbc054ba4cfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:05.734235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-803a8c5d-c50b-4863-9714-dbc054ba4cfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:05.734729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-803a8c5d-c50b-4863-9714-dbc054ba4cfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:05.735168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-803a8c5d-c50b-4863-9714-dbc054ba4cfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:05.735906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-803a8c5d-c50b-4863-9714-dbc054ba4cfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:05.736394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-803a8c5d-c50b-4863-9714-dbc054ba4cfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:05.736821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-803a8c5d-c50b-4863-9714-dbc054ba4cfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:05.781158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-803a8c5d-c50b-4863-9714-dbc054ba4cfc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062673 Aug 29 22:50:05.782261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 450/912] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:06.059017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f116c419-7210-4bba-90fb-db1dce3f61a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:06.062202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f116c419-7210-4bba-90fb-db1dce3f61a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:06.070747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f116c419-7210-4bba-90fb-db1dce3f61a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:06.071274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f116c419-7210-4bba-90fb-db1dce3f61a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:06.071768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f116c419-7210-4bba-90fb-db1dce3f61a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:06.072678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f116c419-7210-4bba-90fb-db1dce3f61a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:06.073203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f116c419-7210-4bba-90fb-db1dce3f61a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:06.073681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f116c419-7210-4bba-90fb-db1dce3f61a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:06.109235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f116c419-7210-4bba-90fb-db1dce3f61a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055333 Aug 29 22:50:06.109812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 463/913] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:06.176062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1028a489-7379-4ef3-8576-5896fe5bb991 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:06.180130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1028a489-7379-4ef3-8576-5896fe5bb991 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:06.189838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1028a489-7379-4ef3-8576-5896fe5bb991 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:06.190340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1028a489-7379-4ef3-8576-5896fe5bb991 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:06.190840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1028a489-7379-4ef3-8576-5896fe5bb991 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:06.191508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1028a489-7379-4ef3-8576-5896fe5bb991 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:06.191964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1028a489-7379-4ef3-8576-5896fe5bb991 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:06.192424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1028a489-7379-4ef3-8576-5896fe5bb991 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:06.227345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1028a489-7379-4ef3-8576-5896fe5bb991 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057531 Aug 29 22:50:06.227962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 451/914] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:06.564445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:06.565510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:06.573124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:06.573653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:06.574094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:06.574831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:06.575375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:06.576030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:06.646824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:06.655412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bd5fe252-a7fe-445c-b902-93fd45570ba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.098472 Aug 29 22:50:06.656129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 464/915] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:06 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:06.798560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c50ef40c-9177-4680-b9b5-2896146535e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:06.800850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c50ef40c-9177-4680-b9b5-2896146535e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:06.808571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50ef40c-9177-4680-b9b5-2896146535e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:06.809483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50ef40c-9177-4680-b9b5-2896146535e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:06.809769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50ef40c-9177-4680-b9b5-2896146535e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:06.810604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50ef40c-9177-4680-b9b5-2896146535e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:06.811105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50ef40c-9177-4680-b9b5-2896146535e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:06.811575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c50ef40c-9177-4680-b9b5-2896146535e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:06.847309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c50ef40c-9177-4680-b9b5-2896146535e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053231 Aug 29 22:50:06.847811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 452/916] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:07.127657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-108bd906-ccb6-44ec-a98f-8ed55b48de40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:07.131323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-108bd906-ccb6-44ec-a98f-8ed55b48de40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:07.141650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108bd906-ccb6-44ec-a98f-8ed55b48de40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.149715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108bd906-ccb6-44ec-a98f-8ed55b48de40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.149715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108bd906-ccb6-44ec-a98f-8ed55b48de40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.149715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108bd906-ccb6-44ec-a98f-8ed55b48de40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.149715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108bd906-ccb6-44ec-a98f-8ed55b48de40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.150324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108bd906-ccb6-44ec-a98f-8ed55b48de40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.181819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-108bd906-ccb6-44ec-a98f-8ed55b48de40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061591 Aug 29 22:50:07.182416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 465/917] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:07.244991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-89a8a14f-cd9e-400d-b928-b0af084a3a2c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:07.247624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-89a8a14f-cd9e-400d-b928-b0af084a3a2c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:07.254728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89a8a14f-cd9e-400d-b928-b0af084a3a2c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.255206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89a8a14f-cd9e-400d-b928-b0af084a3a2c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.256185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89a8a14f-cd9e-400d-b928-b0af084a3a2c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.257001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89a8a14f-cd9e-400d-b928-b0af084a3a2c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.257660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89a8a14f-cd9e-400d-b928-b0af084a3a2c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.258282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89a8a14f-cd9e-400d-b928-b0af084a3a2c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.291751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-89a8a14f-cd9e-400d-b928-b0af084a3a2c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053743 Aug 29 22:50:07.300312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 453/918] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:07.681239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:07.681848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:07.689377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.690203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.690703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.691470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.692057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.692563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.778712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:07.787493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f466d094-49c2-4d43-acbd-7321464033fe tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.110811 Aug 29 22:50:07.788920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 466/919] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:07 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:07.861634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-45c0cb90-8a61-4973-8d61-9d5494607136 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:07.863950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-45c0cb90-8a61-4973-8d61-9d5494607136 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:07.872401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45c0cb90-8a61-4973-8d61-9d5494607136 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.873049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45c0cb90-8a61-4973-8d61-9d5494607136 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.873587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45c0cb90-8a61-4973-8d61-9d5494607136 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.874411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45c0cb90-8a61-4973-8d61-9d5494607136 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.875044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45c0cb90-8a61-4973-8d61-9d5494607136 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.875574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45c0cb90-8a61-4973-8d61-9d5494607136 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.915488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-45c0cb90-8a61-4973-8d61-9d5494607136 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057780 Aug 29 22:50:07.916324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 454/920] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:08.199338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e428451c-c180-4d2e-afc7-3129bbb8dd0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:08.202962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e428451c-c180-4d2e-afc7-3129bbb8dd0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:08.213504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e428451c-c180-4d2e-afc7-3129bbb8dd0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.214095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e428451c-c180-4d2e-afc7-3129bbb8dd0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.214588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e428451c-c180-4d2e-afc7-3129bbb8dd0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.215662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e428451c-c180-4d2e-afc7-3129bbb8dd0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.216127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e428451c-c180-4d2e-afc7-3129bbb8dd0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.216596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e428451c-c180-4d2e-afc7-3129bbb8dd0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.249359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e428451c-c180-4d2e-afc7-3129bbb8dd0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058013 Aug 29 22:50:08.249951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 467/921] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:08.310957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b15a1732-0f5e-4ac0-94da-4cf47fcfa6a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:08.314540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b15a1732-0f5e-4ac0-94da-4cf47fcfa6a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:08.326048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b15a1732-0f5e-4ac0-94da-4cf47fcfa6a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.326876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b15a1732-0f5e-4ac0-94da-4cf47fcfa6a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.327617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b15a1732-0f5e-4ac0-94da-4cf47fcfa6a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.328895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b15a1732-0f5e-4ac0-94da-4cf47fcfa6a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.329733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b15a1732-0f5e-4ac0-94da-4cf47fcfa6a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.330473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b15a1732-0f5e-4ac0-94da-4cf47fcfa6a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.379357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b15a1732-0f5e-4ac0-94da-4cf47fcfa6a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076408 Aug 29 22:50:08.381224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 455/922] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:08.812457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:08.813443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:08.823539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.824318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.825004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.826099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.826836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.827464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.909115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:08.918405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fdb91209-f367-4c0a-b67f-53f398f33427 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.112433 Aug 29 22:50:08.920636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 468/923] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:08 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:08.937347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cfe85841-d28e-473b-96bc-a88e154360d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:08.941516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cfe85841-d28e-473b-96bc-a88e154360d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:08.951050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfe85841-d28e-473b-96bc-a88e154360d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.951675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfe85841-d28e-473b-96bc-a88e154360d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.952441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfe85841-d28e-473b-96bc-a88e154360d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.953468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfe85841-d28e-473b-96bc-a88e154360d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.953985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfe85841-d28e-473b-96bc-a88e154360d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.954415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfe85841-d28e-473b-96bc-a88e154360d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:09.003445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cfe85841-d28e-473b-96bc-a88e154360d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073398 Aug 29 22:50:09.004339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 456/924] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:09.262335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c1d1365b-7102-45cc-b9da-85b33c413fb9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:09.264654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c1d1365b-7102-45cc-b9da-85b33c413fb9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:09.272904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1d1365b-7102-45cc-b9da-85b33c413fb9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:09.273176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1d1365b-7102-45cc-b9da-85b33c413fb9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:09.273541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1d1365b-7102-45cc-b9da-85b33c413fb9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:09.274256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1d1365b-7102-45cc-b9da-85b33c413fb9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:09.274715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1d1365b-7102-45cc-b9da-85b33c413fb9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:09.275138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1d1365b-7102-45cc-b9da-85b33c413fb9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:09.313337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c1d1365b-7102-45cc-b9da-85b33c413fb9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055182 Aug 29 22:50:09.314200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 469/925] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:09 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:09.393758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a91a862d-f386-46ae-b0e7-17508a5712d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:09.396016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a91a862d-f386-46ae-b0e7-17508a5712d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:09.403731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a91a862d-f386-46ae-b0e7-17508a5712d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:09.404253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a91a862d-f386-46ae-b0e7-17508a5712d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:09.404700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a91a862d-f386-46ae-b0e7-17508a5712d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:09.405419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a91a862d-f386-46ae-b0e7-17508a5712d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:09.405879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a91a862d-f386-46ae-b0e7-17508a5712d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:09.406298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a91a862d-f386-46ae-b0e7-17508a5712d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:09.442505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a91a862d-f386-46ae-b0e7-17508a5712d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053240 Aug 29 22:50:09.443090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 457/926] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:09.953510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:09.954158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:09.961261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:09.961759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:09.962198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:09.962944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:09.963739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:09.964259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.019050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d183ee23-6ce0-4ae4-aa19-38346bada0ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:10.021278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d183ee23-6ce0-4ae4-aa19-38346bada0ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:10.029578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d183ee23-6ce0-4ae4-aa19-38346bada0ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.029578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d183ee23-6ce0-4ae4-aa19-38346bada0ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.029846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d183ee23-6ce0-4ae4-aa19-38346bada0ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.030547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d183ee23-6ce0-4ae4-aa19-38346bada0ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.031007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d183ee23-6ce0-4ae4-aa19-38346bada0ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.031426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d183ee23-6ce0-4ae4-aa19-38346bada0ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.031701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:10.040758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0751a59c-4580-47f3-a9ce-2493f921eb43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091118 Aug 29 22:50:10.041795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 470/927] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:09 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:10.071926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d183ee23-6ce0-4ae4-aa19-38346bada0ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057374 Aug 29 22:50:10.072557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 458/928] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:10.329421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4cb31540-994a-4463-be43-c3ee5eb5a830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:10.331764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4cb31540-994a-4463-be43-c3ee5eb5a830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:10.339025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cb31540-994a-4463-be43-c3ee5eb5a830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.339502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cb31540-994a-4463-be43-c3ee5eb5a830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.339936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cb31540-994a-4463-be43-c3ee5eb5a830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.340663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cb31540-994a-4463-be43-c3ee5eb5a830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.341112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cb31540-994a-4463-be43-c3ee5eb5a830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.341530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4cb31540-994a-4463-be43-c3ee5eb5a830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.344044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:10.386451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4cb31540-994a-4463-be43-c3ee5eb5a830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060112 Aug 29 22:50:10.386451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 471/929] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:10.455349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b6678aaf-1007-4722-9dc4-ef5a578e62d4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:10.458223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b6678aaf-1007-4722-9dc4-ef5a578e62d4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:10.466350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6678aaf-1007-4722-9dc4-ef5a578e62d4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.466876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6678aaf-1007-4722-9dc4-ef5a578e62d4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.467316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6678aaf-1007-4722-9dc4-ef5a578e62d4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.468028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6678aaf-1007-4722-9dc4-ef5a578e62d4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.468649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6678aaf-1007-4722-9dc4-ef5a578e62d4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.469178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6678aaf-1007-4722-9dc4-ef5a578e62d4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.509651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b6678aaf-1007-4722-9dc4-ef5a578e62d4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058267 Aug 29 22:50:10.510418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 459/930] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:11.065050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:11.065662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:11.067642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:11.072873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.073357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.073796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.074511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.075076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.075745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.085518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ec40dd81-ee75-4caa-874a-431e18898d90 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:11.098862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ec40dd81-ee75-4caa-874a-431e18898d90 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:11.098862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec40dd81-ee75-4caa-874a-431e18898d90 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.098862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec40dd81-ee75-4caa-874a-431e18898d90 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.098862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec40dd81-ee75-4caa-874a-431e18898d90 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.099295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec40dd81-ee75-4caa-874a-431e18898d90 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.099295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec40dd81-ee75-4caa-874a-431e18898d90 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.099295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec40dd81-ee75-4caa-874a-431e18898d90 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.135846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ec40dd81-ee75-4caa-874a-431e18898d90 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054213 Aug 29 22:50:11.136975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 460/931] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:11.156361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:11.167037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6f6de096-a7c4-484e-87d7-73387d0fb493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.105308 Aug 29 22:50:11.167037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 472/932] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:11 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:11.401472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4f24303b-8cf8-40a6-827b-b78948baa9b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:11.403652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4f24303b-8cf8-40a6-827b-b78948baa9b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:11.411784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f24303b-8cf8-40a6-827b-b78948baa9b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.412627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f24303b-8cf8-40a6-827b-b78948baa9b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.413353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f24303b-8cf8-40a6-827b-b78948baa9b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.414482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f24303b-8cf8-40a6-827b-b78948baa9b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.415541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f24303b-8cf8-40a6-827b-b78948baa9b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.415978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f24303b-8cf8-40a6-827b-b78948baa9b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.451230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4f24303b-8cf8-40a6-827b-b78948baa9b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054197 Aug 29 22:50:11.451925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 461/933] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:11 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:11.523463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-be882703-a4b0-44e7-a157-f648c834ae96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:11.525701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-be882703-a4b0-44e7-a157-f648c834ae96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:11.535071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be882703-a4b0-44e7-a157-f648c834ae96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.535841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be882703-a4b0-44e7-a157-f648c834ae96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.536469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be882703-a4b0-44e7-a157-f648c834ae96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.537436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be882703-a4b0-44e7-a157-f648c834ae96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.538727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be882703-a4b0-44e7-a157-f648c834ae96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.539315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be882703-a4b0-44e7-a157-f648c834ae96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.576707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-be882703-a4b0-44e7-a157-f648c834ae96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057913 Aug 29 22:50:11.577291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 473/934] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:12.153776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a7ce51d3-87bc-4062-98fc-3c2274af8850 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:12.157157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a7ce51d3-87bc-4062-98fc-3c2274af8850 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:12.169783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ce51d3-87bc-4062-98fc-3c2274af8850 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.170568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ce51d3-87bc-4062-98fc-3c2274af8850 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.171282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ce51d3-87bc-4062-98fc-3c2274af8850 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.172244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ce51d3-87bc-4062-98fc-3c2274af8850 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.172713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ce51d3-87bc-4062-98fc-3c2274af8850 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.173142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ce51d3-87bc-4062-98fc-3c2274af8850 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.191310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:12.192446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:12.203518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.204347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.205048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.206432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.207170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.207873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.211136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a7ce51d3-87bc-4062-98fc-3c2274af8850 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063604 Aug 29 22:50:12.211990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 462/935] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:12.290008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:12.298141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ea6851c8-74c3-462b-9ccd-4dcf53facb1d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.113497 Aug 29 22:50:12.298729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 474/936] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:12 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:12.470285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4f6ae479-e181-4e1e-98f8-8a88485f756f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:12.472443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4f6ae479-e181-4e1e-98f8-8a88485f756f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:12.479061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f6ae479-e181-4e1e-98f8-8a88485f756f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.479587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f6ae479-e181-4e1e-98f8-8a88485f756f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.480029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f6ae479-e181-4e1e-98f8-8a88485f756f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.480763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f6ae479-e181-4e1e-98f8-8a88485f756f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.481224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f6ae479-e181-4e1e-98f8-8a88485f756f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.481645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4f6ae479-e181-4e1e-98f8-8a88485f756f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.532367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4f6ae479-e181-4e1e-98f8-8a88485f756f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065855 Aug 29 22:50:12.533306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 463/937] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:12.591335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-40c88042-1899-49f2-af8f-cca53b450c04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:12.594193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-40c88042-1899-49f2-af8f-cca53b450c04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:12.602625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40c88042-1899-49f2-af8f-cca53b450c04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.603122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40c88042-1899-49f2-af8f-cca53b450c04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.603560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40c88042-1899-49f2-af8f-cca53b450c04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.604300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40c88042-1899-49f2-af8f-cca53b450c04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.604764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40c88042-1899-49f2-af8f-cca53b450c04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.605179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40c88042-1899-49f2-af8f-cca53b450c04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.637648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-40c88042-1899-49f2-af8f-cca53b450c04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051764 Aug 29 22:50:12.638295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 475/938] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:13.227640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8cf439b0-893b-4279-b691-c6a50b685fd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:13.230004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8cf439b0-893b-4279-b691-c6a50b685fd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:13.236808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cf439b0-893b-4279-b691-c6a50b685fd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.237295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cf439b0-893b-4279-b691-c6a50b685fd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.237744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cf439b0-893b-4279-b691-c6a50b685fd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.238426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cf439b0-893b-4279-b691-c6a50b685fd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.238883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cf439b0-893b-4279-b691-c6a50b685fd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.239306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cf439b0-893b-4279-b691-c6a50b685fd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.296375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8cf439b0-893b-4279-b691-c6a50b685fd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073436 Aug 29 22:50:13.297374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 464/939] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:13.324600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:13.325690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:13.339477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.340319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.341057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.342240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.343039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.343772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.439810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:13.450261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c86f3a52-cff4-49d8-aec8-cc216f825445 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.133737 Aug 29 22:50:13.453303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 476/940] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:13 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:13.549173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bb92b1f1-f9b6-40b4-b54a-b078d15211ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:13.551391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bb92b1f1-f9b6-40b4-b54a-b078d15211ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:13.553463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:13.558984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb92b1f1-f9b6-40b4-b54a-b078d15211ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.559464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb92b1f1-f9b6-40b4-b54a-b078d15211ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.559895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb92b1f1-f9b6-40b4-b54a-b078d15211ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.560629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb92b1f1-f9b6-40b4-b54a-b078d15211ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.561084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb92b1f1-f9b6-40b4-b54a-b078d15211ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.561505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb92b1f1-f9b6-40b4-b54a-b078d15211ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.583916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:13.599029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bb92b1f1-f9b6-40b4-b54a-b078d15211ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054319 Aug 29 22:50:13.599632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 465/941] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:13.651644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ae9b9148-6cfe-4155-8c14-ab23747252aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:13.653986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ae9b9148-6cfe-4155-8c14-ab23747252aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:13.660759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae9b9148-6cfe-4155-8c14-ab23747252aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.661284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae9b9148-6cfe-4155-8c14-ab23747252aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.661692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae9b9148-6cfe-4155-8c14-ab23747252aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.662401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae9b9148-6cfe-4155-8c14-ab23747252aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.663683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae9b9148-6cfe-4155-8c14-ab23747252aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.664691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae9b9148-6cfe-4155-8c14-ab23747252aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.711106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ae9b9148-6cfe-4155-8c14-ab23747252aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064786 Aug 29 22:50:13.715995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 477/942] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:14.313860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8ea76c7b-9e22-427b-9ca5-f780237a12ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:14.316256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8ea76c7b-9e22-427b-9ca5-f780237a12ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:14.325977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ea76c7b-9e22-427b-9ca5-f780237a12ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.326472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ea76c7b-9e22-427b-9ca5-f780237a12ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.326910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ea76c7b-9e22-427b-9ca5-f780237a12ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.327629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ea76c7b-9e22-427b-9ca5-f780237a12ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.328084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ea76c7b-9e22-427b-9ca5-f780237a12ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.328559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ea76c7b-9e22-427b-9ca5-f780237a12ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.366691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8ea76c7b-9e22-427b-9ca5-f780237a12ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057437 Aug 29 22:50:14.367291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 466/943] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:14.474118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:14.474960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:14.483107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.483590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.484028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.484776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.485233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.485652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.537248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9fb0a922-3483-4cbe-bf38-121d108d0311 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:14.538755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9fb0a922-3483-4cbe-bf38-121d108d0311 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:14.546392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9fb0a922-3483-4cbe-bf38-121d108d0311 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.546392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9fb0a922-3483-4cbe-bf38-121d108d0311 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.546823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9fb0a922-3483-4cbe-bf38-121d108d0311 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.547558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9fb0a922-3483-4cbe-bf38-121d108d0311 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.548039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9fb0a922-3483-4cbe-bf38-121d108d0311 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.548488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9fb0a922-3483-4cbe-bf38-121d108d0311 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.565492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:14.575906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-85b82a61-8690-413c-b784-31664bd012ae tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.106223 Aug 29 22:50:14.576861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 478/944] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:14 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:14.582131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9fb0a922-3483-4cbe-bf38-121d108d0311 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383/ips" status: 200 len: 147 microversion: 2.1 time: 0.048519 Aug 29 22:50:14.583164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 467/945] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 22:50:14 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383/ips => generated 147 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:14.615137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f4926a34-7260-456c-8f93-a3c7e2ff3cc6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:14.618485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f4926a34-7260-456c-8f93-a3c7e2ff3cc6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:14.624737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4926a34-7260-456c-8f93-a3c7e2ff3cc6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.625259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4926a34-7260-456c-8f93-a3c7e2ff3cc6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.625699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4926a34-7260-456c-8f93-a3c7e2ff3cc6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.626419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4926a34-7260-456c-8f93-a3c7e2ff3cc6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.626878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4926a34-7260-456c-8f93-a3c7e2ff3cc6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.627302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4926a34-7260-456c-8f93-a3c7e2ff3cc6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.664872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f4926a34-7260-456c-8f93-a3c7e2ff3cc6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053276 Aug 29 22:50:14.665927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 479/946] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:14.725813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e1619c01-61a7-4414-98c2-4fa26243b919 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:14.729853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e1619c01-61a7-4414-98c2-4fa26243b919 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:14.741948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1619c01-61a7-4414-98c2-4fa26243b919 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.742832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1619c01-61a7-4414-98c2-4fa26243b919 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.743634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1619c01-61a7-4414-98c2-4fa26243b919 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.744971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1619c01-61a7-4414-98c2-4fa26243b919 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.745831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1619c01-61a7-4414-98c2-4fa26243b919 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.746621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1619c01-61a7-4414-98c2-4fa26243b919 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.784732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e1619c01-61a7-4414-98c2-4fa26243b919 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064496 Aug 29 22:50:14.785405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 468/947] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:15.380162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a1bae7d6-c524-4216-bd1e-7dee8d7975aa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:15.383545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a1bae7d6-c524-4216-bd1e-7dee8d7975aa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:15.391133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1bae7d6-c524-4216-bd1e-7dee8d7975aa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.391725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1bae7d6-c524-4216-bd1e-7dee8d7975aa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.392259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1bae7d6-c524-4216-bd1e-7dee8d7975aa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.393428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1bae7d6-c524-4216-bd1e-7dee8d7975aa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.394261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1bae7d6-c524-4216-bd1e-7dee8d7975aa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.394930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1bae7d6-c524-4216-bd1e-7dee8d7975aa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.432387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a1bae7d6-c524-4216-bd1e-7dee8d7975aa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056138 Aug 29 22:50:15.432972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 480/948] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:15.604591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:15.605213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:15.611981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.612566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.613153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.613909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.614411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.614891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.687317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1254c910-68d7-4ec4-92df-2fa29c86ca10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:15.689186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1254c910-68d7-4ec4-92df-2fa29c86ca10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:15.689569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:15.697779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1254c910-68d7-4ec4-92df-2fa29c86ca10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.698349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1254c910-68d7-4ec4-92df-2fa29c86ca10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.698852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1254c910-68d7-4ec4-92df-2fa29c86ca10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.699228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e06cc8c3-0caf-46e2-b457-dc4a417d3477 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.099638 Aug 29 22:50:15.699837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 469/949] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:15 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:15.700516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1254c910-68d7-4ec4-92df-2fa29c86ca10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.701119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1254c910-68d7-4ec4-92df-2fa29c86ca10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.701645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1254c910-68d7-4ec4-92df-2fa29c86ca10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.746434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1254c910-68d7-4ec4-92df-2fa29c86ca10 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067879 Aug 29 22:50:15.747462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 481/950] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:15.798975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a4ae751f-5181-49bb-b0d4-aac475c8dbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:15.801375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a4ae751f-5181-49bb-b0d4-aac475c8dbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:15.810551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4ae751f-5181-49bb-b0d4-aac475c8dbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.811100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4ae751f-5181-49bb-b0d4-aac475c8dbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.811582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4ae751f-5181-49bb-b0d4-aac475c8dbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.812396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4ae751f-5181-49bb-b0d4-aac475c8dbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.812896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4ae751f-5181-49bb-b0d4-aac475c8dbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.813438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4ae751f-5181-49bb-b0d4-aac475c8dbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.849214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a4ae751f-5181-49bb-b0d4-aac475c8dbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054935 Aug 29 22:50:15.850313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 470/951] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:16.446301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-447a8c5f-7860-46c5-8f22-0a29c66e3361 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:16.449058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-447a8c5f-7860-46c5-8f22-0a29c66e3361 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:16.457014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-447a8c5f-7860-46c5-8f22-0a29c66e3361 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.458759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-447a8c5f-7860-46c5-8f22-0a29c66e3361 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.458759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-447a8c5f-7860-46c5-8f22-0a29c66e3361 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.459011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-447a8c5f-7860-46c5-8f22-0a29c66e3361 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.460168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-447a8c5f-7860-46c5-8f22-0a29c66e3361 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.460850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-447a8c5f-7860-46c5-8f22-0a29c66e3361 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.500456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-447a8c5f-7860-46c5-8f22-0a29c66e3361 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058899 Aug 29 22:50:16.501054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 482/952] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:16.738912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:16.739909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:16.751064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.751890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.752705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.753926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.754738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.755549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.761839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c9f3ce5e-abf8-468e-833e-37c6e5c34e54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:16.764288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c9f3ce5e-abf8-468e-833e-37c6e5c34e54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:16.772444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9f3ce5e-abf8-468e-833e-37c6e5c34e54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.773265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9f3ce5e-abf8-468e-833e-37c6e5c34e54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.774034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9f3ce5e-abf8-468e-833e-37c6e5c34e54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.774963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9f3ce5e-abf8-468e-833e-37c6e5c34e54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.775457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9f3ce5e-abf8-468e-833e-37c6e5c34e54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.775884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9f3ce5e-abf8-468e-833e-37c6e5c34e54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.814184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c9f3ce5e-abf8-468e-833e-37c6e5c34e54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056484 Aug 29 22:50:16.814784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 483/953] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:16.835471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:16.844948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6e9445b3-6a39-4593-8468-06d24e60cb94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.112734 Aug 29 22:50:16.845823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 471/954] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:16 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:16.865242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cf7bc7d1-8bf8-4c53-8749-430b3fd76b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:16.869212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cf7bc7d1-8bf8-4c53-8749-430b3fd76b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:16.880319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf7bc7d1-8bf8-4c53-8749-430b3fd76b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.882073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf7bc7d1-8bf8-4c53-8749-430b3fd76b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.882487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf7bc7d1-8bf8-4c53-8749-430b3fd76b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.883566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf7bc7d1-8bf8-4c53-8749-430b3fd76b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.884369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf7bc7d1-8bf8-4c53-8749-430b3fd76b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.885111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf7bc7d1-8bf8-4c53-8749-430b3fd76b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.935763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cf7bc7d1-8bf8-4c53-8749-430b3fd76b69 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077435 Aug 29 22:50:16.936591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 484/955] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:17.515961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-be5b52bc-60b8-443a-99d8-fb38ef107c54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:17.518420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-be5b52bc-60b8-443a-99d8-fb38ef107c54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:17.525647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-be5b52bc-60b8-443a-99d8-fb38ef107c54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.526121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-be5b52bc-60b8-443a-99d8-fb38ef107c54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.526549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-be5b52bc-60b8-443a-99d8-fb38ef107c54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.527240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-be5b52bc-60b8-443a-99d8-fb38ef107c54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.527683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-be5b52bc-60b8-443a-99d8-fb38ef107c54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.528092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-be5b52bc-60b8-443a-99d8-fb38ef107c54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.562929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-be5b52bc-60b8-443a-99d8-fb38ef107c54 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050855 Aug 29 22:50:17.563536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 472/956] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:17.826384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d4e220e7-650c-435b-ab47-11be508073d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:17.828607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d4e220e7-650c-435b-ab47-11be508073d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:17.836011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4e220e7-650c-435b-ab47-11be508073d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.836548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4e220e7-650c-435b-ab47-11be508073d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.837020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4e220e7-650c-435b-ab47-11be508073d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.837812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4e220e7-650c-435b-ab47-11be508073d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.838222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4e220e7-650c-435b-ab47-11be508073d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.838645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4e220e7-650c-435b-ab47-11be508073d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.878299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:17.879296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:17.879440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d4e220e7-650c-435b-ab47-11be508073d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057112 Aug 29 22:50:17.880583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 485/957] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:17.891627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.892487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.893309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.894641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.895499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.896232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.952928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d721c50b-73ef-4031-ad25-e2c647cf9088 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:17.956325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d721c50b-73ef-4031-ad25-e2c647cf9088 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:17.967325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d721c50b-73ef-4031-ad25-e2c647cf9088 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.967832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d721c50b-73ef-4031-ad25-e2c647cf9088 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.968320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d721c50b-73ef-4031-ad25-e2c647cf9088 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.969074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d721c50b-73ef-4031-ad25-e2c647cf9088 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.969649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d721c50b-73ef-4031-ad25-e2c647cf9088 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.970082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d721c50b-73ef-4031-ad25-e2c647cf9088 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.983027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:17.993515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4d38abad-ea4a-4c2c-b619-c8c786fe5bc2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.122696 Aug 29 22:50:17.994136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 473/958] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:17 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:18.021117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d721c50b-73ef-4031-ad25-e2c647cf9088 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073134 Aug 29 22:50:18.022673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 486/959] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:18.576948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-95362b5a-91bb-40ed-b813-53cdb360c000 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:18.579068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-95362b5a-91bb-40ed-b813-53cdb360c000 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:18.586738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95362b5a-91bb-40ed-b813-53cdb360c000 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:18.587228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95362b5a-91bb-40ed-b813-53cdb360c000 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:18.587677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95362b5a-91bb-40ed-b813-53cdb360c000 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:18.588434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95362b5a-91bb-40ed-b813-53cdb360c000 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:18.588890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95362b5a-91bb-40ed-b813-53cdb360c000 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:18.589308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95362b5a-91bb-40ed-b813-53cdb360c000 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:18.622934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-95362b5a-91bb-40ed-b813-53cdb360c000 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050053 Aug 29 22:50:18.623725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 474/960] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:18.893480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-19127357-1068-4444-b2e7-8bfe0325b158 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:18.895674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-19127357-1068-4444-b2e7-8bfe0325b158 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:18.902654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19127357-1068-4444-b2e7-8bfe0325b158 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:18.903251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19127357-1068-4444-b2e7-8bfe0325b158 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:18.903825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19127357-1068-4444-b2e7-8bfe0325b158 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:18.904712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19127357-1068-4444-b2e7-8bfe0325b158 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:18.905276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19127357-1068-4444-b2e7-8bfe0325b158 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:18.905805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19127357-1068-4444-b2e7-8bfe0325b158 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:18.938887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:18.946852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-19127357-1068-4444-b2e7-8bfe0325b158 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057245 Aug 29 22:50:18.947452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 487/961] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:19.035456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-886b14a4-1e44-4da7-a331-954d65824b12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:19.038131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-886b14a4-1e44-4da7-a331-954d65824b12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:19.045521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-886b14a4-1e44-4da7-a331-954d65824b12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.046005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-886b14a4-1e44-4da7-a331-954d65824b12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.046439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-886b14a4-1e44-4da7-a331-954d65824b12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.047142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-886b14a4-1e44-4da7-a331-954d65824b12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.047598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-886b14a4-1e44-4da7-a331-954d65824b12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.048026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-886b14a4-1e44-4da7-a331-954d65824b12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.081890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:19.082903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:19.090790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-886b14a4-1e44-4da7-a331-954d65824b12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059598 Aug 29 22:50:19.091687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 475/962] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:19.092049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.092702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.093336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.094165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.094750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.095301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.162984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:19.172070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dd1bc6f4-901c-4c38-8fd3-d84a4eb07d5d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094910 Aug 29 22:50:19.172694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 488/963] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:19 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:19.640347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dbb0ea16-1363-4847-8b47-4b851d340958 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:19.644101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dbb0ea16-1363-4847-8b47-4b851d340958 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:19.654664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb0ea16-1363-4847-8b47-4b851d340958 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.655437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb0ea16-1363-4847-8b47-4b851d340958 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.656197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb0ea16-1363-4847-8b47-4b851d340958 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.657433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb0ea16-1363-4847-8b47-4b851d340958 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.658266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb0ea16-1363-4847-8b47-4b851d340958 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.659002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb0ea16-1363-4847-8b47-4b851d340958 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.694937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dbb0ea16-1363-4847-8b47-4b851d340958 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062187 Aug 29 22:50:19.695647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 476/964] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:19.962372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a02d136e-00cc-46db-acf3-a51a02e4938b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:19.964592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a02d136e-00cc-46db-acf3-a51a02e4938b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:19.971639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02d136e-00cc-46db-acf3-a51a02e4938b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.972252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02d136e-00cc-46db-acf3-a51a02e4938b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.972690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02d136e-00cc-46db-acf3-a51a02e4938b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.973397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02d136e-00cc-46db-acf3-a51a02e4938b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.973852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02d136e-00cc-46db-acf3-a51a02e4938b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.974277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02d136e-00cc-46db-acf3-a51a02e4938b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.008513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a02d136e-00cc-46db-acf3-a51a02e4938b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050534 Aug 29 22:50:20.009098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 489/965] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:20.105790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cabb7484-e771-443c-8a3e-c179eda4ca78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:20.108414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cabb7484-e771-443c-8a3e-c179eda4ca78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:20.115351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cabb7484-e771-443c-8a3e-c179eda4ca78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.116648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cabb7484-e771-443c-8a3e-c179eda4ca78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.117354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cabb7484-e771-443c-8a3e-c179eda4ca78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.118063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cabb7484-e771-443c-8a3e-c179eda4ca78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.118517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cabb7484-e771-443c-8a3e-c179eda4ca78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.118937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cabb7484-e771-443c-8a3e-c179eda4ca78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.154450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cabb7484-e771-443c-8a3e-c179eda4ca78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052804 Aug 29 22:50:20.155050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 477/966] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:20.193118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:20.193685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:20.200219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.200714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.201152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.201854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.202359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.202785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.276290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:20.293787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-28c01bdd-8a13-407a-ab33-821ae1373df9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.104617 Aug 29 22:50:20.294536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 490/967] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:20 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:20.708074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2215ab7c-39d0-42fd-b2c1-935fa7cb4551 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:20.711328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2215ab7c-39d0-42fd-b2c1-935fa7cb4551 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:20.718280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2215ab7c-39d0-42fd-b2c1-935fa7cb4551 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.718755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2215ab7c-39d0-42fd-b2c1-935fa7cb4551 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.719185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2215ab7c-39d0-42fd-b2c1-935fa7cb4551 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.719873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2215ab7c-39d0-42fd-b2c1-935fa7cb4551 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.720394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2215ab7c-39d0-42fd-b2c1-935fa7cb4551 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.720819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2215ab7c-39d0-42fd-b2c1-935fa7cb4551 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.759923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2215ab7c-39d0-42fd-b2c1-935fa7cb4551 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055650 Aug 29 22:50:20.760628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 478/968] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:21.021504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d55156b3-2155-4210-b678-5be9abce8664 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:21.024523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d55156b3-2155-4210-b678-5be9abce8664 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:21.031580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d55156b3-2155-4210-b678-5be9abce8664 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.032248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d55156b3-2155-4210-b678-5be9abce8664 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.032798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d55156b3-2155-4210-b678-5be9abce8664 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.033604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d55156b3-2155-4210-b678-5be9abce8664 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.034161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d55156b3-2155-4210-b678-5be9abce8664 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.034738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d55156b3-2155-4210-b678-5be9abce8664 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.069526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d55156b3-2155-4210-b678-5be9abce8664 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052948 Aug 29 22:50:21.070168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 491/969] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:21 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:21.168242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-639095bd-5a6e-46ea-8546-69ff9f50b70d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:21.170567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-639095bd-5a6e-46ea-8546-69ff9f50b70d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:21.177635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-639095bd-5a6e-46ea-8546-69ff9f50b70d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.179819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-639095bd-5a6e-46ea-8546-69ff9f50b70d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.179819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-639095bd-5a6e-46ea-8546-69ff9f50b70d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.179819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-639095bd-5a6e-46ea-8546-69ff9f50b70d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.179819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-639095bd-5a6e-46ea-8546-69ff9f50b70d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.180552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-639095bd-5a6e-46ea-8546-69ff9f50b70d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.214235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-639095bd-5a6e-46ea-8546-69ff9f50b70d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050263 Aug 29 22:50:21.214890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 479/970] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:21.315504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:21.316032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:21.323634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.324131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.324606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.325337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.325796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.326221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.399867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:21.408590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-be5c788f-a3e9-4ada-9f4a-92068fe750bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.097141 Aug 29 22:50:21.409174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 492/971] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:21 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:21.774044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e44adbe1-a3bd-48b8-b1d6-9422a049e389 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:21.776628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e44adbe1-a3bd-48b8-b1d6-9422a049e389 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:21.783814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e44adbe1-a3bd-48b8-b1d6-9422a049e389 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.784338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e44adbe1-a3bd-48b8-b1d6-9422a049e389 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.784778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e44adbe1-a3bd-48b8-b1d6-9422a049e389 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.785495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e44adbe1-a3bd-48b8-b1d6-9422a049e389 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.785951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e44adbe1-a3bd-48b8-b1d6-9422a049e389 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.786375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e44adbe1-a3bd-48b8-b1d6-9422a049e389 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.821441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e44adbe1-a3bd-48b8-b1d6-9422a049e389 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052476 Aug 29 22:50:21.822055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 480/972] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:22.084102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c544c21f-4dda-4488-bbe5-c3f5f48e77f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:22.087555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c544c21f-4dda-4488-bbe5-c3f5f48e77f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:22.094821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c544c21f-4dda-4488-bbe5-c3f5f48e77f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.095301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c544c21f-4dda-4488-bbe5-c3f5f48e77f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.095738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c544c21f-4dda-4488-bbe5-c3f5f48e77f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.096477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c544c21f-4dda-4488-bbe5-c3f5f48e77f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.096929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c544c21f-4dda-4488-bbe5-c3f5f48e77f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.097347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c544c21f-4dda-4488-bbe5-c3f5f48e77f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.132660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c544c21f-4dda-4488-bbe5-c3f5f48e77f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053754 Aug 29 22:50:22.133249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 493/973] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:22.227861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-735fa1f4-21cf-4323-934f-3b2dd3402722 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:22.230217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-735fa1f4-21cf-4323-934f-3b2dd3402722 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:22.237218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735fa1f4-21cf-4323-934f-3b2dd3402722 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.237712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735fa1f4-21cf-4323-934f-3b2dd3402722 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.238163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735fa1f4-21cf-4323-934f-3b2dd3402722 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.238902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735fa1f4-21cf-4323-934f-3b2dd3402722 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.239356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735fa1f4-21cf-4323-934f-3b2dd3402722 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.239781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-735fa1f4-21cf-4323-934f-3b2dd3402722 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.278442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-735fa1f4-21cf-4323-934f-3b2dd3402722 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055019 Aug 29 22:50:22.279036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 481/974] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:22.431996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:22.432655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:22.439176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.439716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.440207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.440907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.441389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.441814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.512724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:22.521092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f2e7bacd-7e0b-4c6b-84c8-dc8442d8b8f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093216 Aug 29 22:50:22.522351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 494/975] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:22 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:22.834855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f95bd36d-d0fa-4e67-baa0-7157d8698d67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:22.837893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f95bd36d-d0fa-4e67-baa0-7157d8698d67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:22.846767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f95bd36d-d0fa-4e67-baa0-7157d8698d67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.847250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f95bd36d-d0fa-4e67-baa0-7157d8698d67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.847682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f95bd36d-d0fa-4e67-baa0-7157d8698d67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.848451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f95bd36d-d0fa-4e67-baa0-7157d8698d67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.848900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f95bd36d-d0fa-4e67-baa0-7157d8698d67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.849318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f95bd36d-d0fa-4e67-baa0-7157d8698d67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.868451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:22.883397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f95bd36d-d0fa-4e67-baa0-7157d8698d67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053187 Aug 29 22:50:22.884036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 482/976] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:23.149557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-135415fb-beac-4d46-8220-5529bac5cb61 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:23.151920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-135415fb-beac-4d46-8220-5529bac5cb61 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:23.158509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-135415fb-beac-4d46-8220-5529bac5cb61 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.158993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-135415fb-beac-4d46-8220-5529bac5cb61 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.159435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-135415fb-beac-4d46-8220-5529bac5cb61 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.160127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-135415fb-beac-4d46-8220-5529bac5cb61 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.160609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-135415fb-beac-4d46-8220-5529bac5cb61 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.161027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-135415fb-beac-4d46-8220-5529bac5cb61 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.198970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-135415fb-beac-4d46-8220-5529bac5cb61 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054053 Aug 29 22:50:23.199556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 495/977] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:23.293250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-164778c5-ff5a-49fb-96c6-c26ecc4b6b49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:23.295408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-164778c5-ff5a-49fb-96c6-c26ecc4b6b49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:23.302192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-164778c5-ff5a-49fb-96c6-c26ecc4b6b49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.302699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-164778c5-ff5a-49fb-96c6-c26ecc4b6b49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.303129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-164778c5-ff5a-49fb-96c6-c26ecc4b6b49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.303836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-164778c5-ff5a-49fb-96c6-c26ecc4b6b49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.304333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-164778c5-ff5a-49fb-96c6-c26ecc4b6b49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.304750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-164778c5-ff5a-49fb-96c6-c26ecc4b6b49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.340877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-164778c5-ff5a-49fb-96c6-c26ecc4b6b49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052420 Aug 29 22:50:23.341463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 483/978] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:23.545258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:23.545930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:23.552758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.553750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.554248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.555001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.555584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.556048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.623446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:23.632949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-823f5d2c-ad8d-4a99-b990-0442e2ccfd66 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091148 Aug 29 22:50:23.633204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 496/979] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:23 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:23.896331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9430026f-c5a0-452f-9974-16d727f71924 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:23.898837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9430026f-c5a0-452f-9974-16d727f71924 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:23.905409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9430026f-c5a0-452f-9974-16d727f71924 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.905888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9430026f-c5a0-452f-9974-16d727f71924 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.906316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9430026f-c5a0-452f-9974-16d727f71924 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.907006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9430026f-c5a0-452f-9974-16d727f71924 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.907452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9430026f-c5a0-452f-9974-16d727f71924 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.907868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9430026f-c5a0-452f-9974-16d727f71924 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.090278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9430026f-c5a0-452f-9974-16d727f71924 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198134 Aug 29 22:50:24.090874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 484/980] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:24.211718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9df11695-4ec5-4b2c-a35a-c5ddeb3d1f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:24.213843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9df11695-4ec5-4b2c-a35a-c5ddeb3d1f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:24.219951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9df11695-4ec5-4b2c-a35a-c5ddeb3d1f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:24.220457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9df11695-4ec5-4b2c-a35a-c5ddeb3d1f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:24.220890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9df11695-4ec5-4b2c-a35a-c5ddeb3d1f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.221585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9df11695-4ec5-4b2c-a35a-c5ddeb3d1f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:24.222031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9df11695-4ec5-4b2c-a35a-c5ddeb3d1f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:24.222451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9df11695-4ec5-4b2c-a35a-c5ddeb3d1f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.254485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9df11695-4ec5-4b2c-a35a-c5ddeb3d1f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046896 Aug 29 22:50:24.255060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 497/981] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:24.352884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aaa298bb-b7c4-480c-9889-b66697f52508 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:24.355353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aaa298bb-b7c4-480c-9889-b66697f52508 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:24.361600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aaa298bb-b7c4-480c-9889-b66697f52508 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:24.362153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aaa298bb-b7c4-480c-9889-b66697f52508 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:24.362586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aaa298bb-b7c4-480c-9889-b66697f52508 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.363274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aaa298bb-b7c4-480c-9889-b66697f52508 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:24.363716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aaa298bb-b7c4-480c-9889-b66697f52508 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:24.364144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aaa298bb-b7c4-480c-9889-b66697f52508 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.397656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aaa298bb-b7c4-480c-9889-b66697f52508 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048650 Aug 29 22:50:24.398405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 485/982] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:24.653826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:24.654418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:24.661151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:24.661600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:24.662023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.663253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:24.663767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:24.664282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.733479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:24.743237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1ca47249-4ebd-45c4-a90e-8119d1f77b68 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093217 Aug 29 22:50:24.743832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 498/983] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:24 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:25.103694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6e77d2ab-6a54-4698-98e9-babc9b56a54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:25.105816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6e77d2ab-6a54-4698-98e9-babc9b56a54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:25.117860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e77d2ab-6a54-4698-98e9-babc9b56a54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.118350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e77d2ab-6a54-4698-98e9-babc9b56a54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.118786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e77d2ab-6a54-4698-98e9-babc9b56a54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.119513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e77d2ab-6a54-4698-98e9-babc9b56a54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.120009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e77d2ab-6a54-4698-98e9-babc9b56a54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.120448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e77d2ab-6a54-4698-98e9-babc9b56a54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.155738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6e77d2ab-6a54-4698-98e9-babc9b56a54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056459 Aug 29 22:50:25.156378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 486/984] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:25.269973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1c50a995-1353-4eb6-87de-4c9722e1f7ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:25.273286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1c50a995-1353-4eb6-87de-4c9722e1f7ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:25.279846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c50a995-1353-4eb6-87de-4c9722e1f7ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.280384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c50a995-1353-4eb6-87de-4c9722e1f7ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.280831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c50a995-1353-4eb6-87de-4c9722e1f7ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.281557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c50a995-1353-4eb6-87de-4c9722e1f7ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.282016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c50a995-1353-4eb6-87de-4c9722e1f7ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.282446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c50a995-1353-4eb6-87de-4c9722e1f7ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.317768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1c50a995-1353-4eb6-87de-4c9722e1f7ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052958 Aug 29 22:50:25.318373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 499/985] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:25.410868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-454c4dec-6eeb-4d79-bd3f-e9fc4acfa48d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:25.413321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-454c4dec-6eeb-4d79-bd3f-e9fc4acfa48d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:25.419751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c4dec-6eeb-4d79-bd3f-e9fc4acfa48d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.420279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c4dec-6eeb-4d79-bd3f-e9fc4acfa48d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.420721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c4dec-6eeb-4d79-bd3f-e9fc4acfa48d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.421431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c4dec-6eeb-4d79-bd3f-e9fc4acfa48d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.421881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c4dec-6eeb-4d79-bd3f-e9fc4acfa48d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.422306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c4dec-6eeb-4d79-bd3f-e9fc4acfa48d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.455146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-454c4dec-6eeb-4d79-bd3f-e9fc4acfa48d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048338 Aug 29 22:50:25.456822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 487/986] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:25.767544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:25.768652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:25.776594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.777210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.777792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.778234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.778864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.779621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.854481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:25.868219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8974c507-a499-4960-b39f-c51707ce85c3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.104406 Aug 29 22:50:25.869008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 500/987] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:26.169809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-07be7440-f727-4a25-a9c2-18fcfe97f946 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:26.172106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-07be7440-f727-4a25-a9c2-18fcfe97f946 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:26.179767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07be7440-f727-4a25-a9c2-18fcfe97f946 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.180262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07be7440-f727-4a25-a9c2-18fcfe97f946 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.180700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07be7440-f727-4a25-a9c2-18fcfe97f946 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.181409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07be7440-f727-4a25-a9c2-18fcfe97f946 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.181862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07be7440-f727-4a25-a9c2-18fcfe97f946 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.182281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07be7440-f727-4a25-a9c2-18fcfe97f946 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.215861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-07be7440-f727-4a25-a9c2-18fcfe97f946 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050663 Aug 29 22:50:26.216499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 488/988] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:26.332813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-25009262-705d-495c-a729-0af4ec4a0632 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:26.335809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-25009262-705d-495c-a729-0af4ec4a0632 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:26.342239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25009262-705d-495c-a729-0af4ec4a0632 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.342750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25009262-705d-495c-a729-0af4ec4a0632 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.343334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25009262-705d-495c-a729-0af4ec4a0632 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.344023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25009262-705d-495c-a729-0af4ec4a0632 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.344494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25009262-705d-495c-a729-0af4ec4a0632 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.344914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25009262-705d-495c-a729-0af4ec4a0632 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.378475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-25009262-705d-495c-a729-0af4ec4a0632 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050247 Aug 29 22:50:26.379078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 501/989] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:26.471900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5b91aa82-6d0c-4656-9440-4a6d57116f1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:26.474186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5b91aa82-6d0c-4656-9440-4a6d57116f1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:26.481921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b91aa82-6d0c-4656-9440-4a6d57116f1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.482407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b91aa82-6d0c-4656-9440-4a6d57116f1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.482846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b91aa82-6d0c-4656-9440-4a6d57116f1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.483549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b91aa82-6d0c-4656-9440-4a6d57116f1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.484004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b91aa82-6d0c-4656-9440-4a6d57116f1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.484461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b91aa82-6d0c-4656-9440-4a6d57116f1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.521459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5b91aa82-6d0c-4656-9440-4a6d57116f1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053597 Aug 29 22:50:26.523208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 489/990] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:26.890960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:26.891571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:26.899607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.900099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.900586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.901317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.901779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.902199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.217152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:27.226173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-97f5ea01-7b9b-4484-870e-f55d5c7740bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.338992 Aug 29 22:50:27.226983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 502/991] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:27.229331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6606edf0-d277-4a9f-bccd-43bc9d73e457 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:27.231676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6606edf0-d277-4a9f-bccd-43bc9d73e457 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:27.238672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6606edf0-d277-4a9f-bccd-43bc9d73e457 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.239163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6606edf0-d277-4a9f-bccd-43bc9d73e457 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.239599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6606edf0-d277-4a9f-bccd-43bc9d73e457 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.240452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6606edf0-d277-4a9f-bccd-43bc9d73e457 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.241209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6606edf0-d277-4a9f-bccd-43bc9d73e457 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.241804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6606edf0-d277-4a9f-bccd-43bc9d73e457 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.277734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6606edf0-d277-4a9f-bccd-43bc9d73e457 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053582 Aug 29 22:50:27.278318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 490/992] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:27.391493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-73db9634-eb3c-4204-8fe4-ccfc818286f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:27.393750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-73db9634-eb3c-4204-8fe4-ccfc818286f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:27.401787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73db9634-eb3c-4204-8fe4-ccfc818286f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.402276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73db9634-eb3c-4204-8fe4-ccfc818286f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.402709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73db9634-eb3c-4204-8fe4-ccfc818286f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.403420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73db9634-eb3c-4204-8fe4-ccfc818286f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.403866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73db9634-eb3c-4204-8fe4-ccfc818286f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.404333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73db9634-eb3c-4204-8fe4-ccfc818286f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.439016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-73db9634-eb3c-4204-8fe4-ccfc818286f0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051340 Aug 29 22:50:27.439998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 503/993] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:27 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:27.535478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0d8a56fc-8ad4-4d25-b93f-ee2700fc8ede tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:27.538937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0d8a56fc-8ad4-4d25-b93f-ee2700fc8ede tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:27.546873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d8a56fc-8ad4-4d25-b93f-ee2700fc8ede tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.547360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d8a56fc-8ad4-4d25-b93f-ee2700fc8ede tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.547790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d8a56fc-8ad4-4d25-b93f-ee2700fc8ede tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.548530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d8a56fc-8ad4-4d25-b93f-ee2700fc8ede tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.548976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d8a56fc-8ad4-4d25-b93f-ee2700fc8ede tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.549413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d8a56fc-8ad4-4d25-b93f-ee2700fc8ede tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.582120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0d8a56fc-8ad4-4d25-b93f-ee2700fc8ede tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050846 Aug 29 22:50:27.582691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 491/994] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:28.248696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:28.249209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:28.255369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.256010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.257305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.258147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.258703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.259186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.276373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:28.291347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-080dad5b-4e51-4294-8ebf-72bb34b7f352 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:28.293569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-080dad5b-4e51-4294-8ebf-72bb34b7f352 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:28.301641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-080dad5b-4e51-4294-8ebf-72bb34b7f352 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.302433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-080dad5b-4e51-4294-8ebf-72bb34b7f352 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.303774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-080dad5b-4e51-4294-8ebf-72bb34b7f352 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.304744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-080dad5b-4e51-4294-8ebf-72bb34b7f352 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.305324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-080dad5b-4e51-4294-8ebf-72bb34b7f352 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.305744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-080dad5b-4e51-4294-8ebf-72bb34b7f352 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.336700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:28.340232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-080dad5b-4e51-4294-8ebf-72bb34b7f352 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053902 Aug 29 22:50:28.341129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 492/995] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:28.352354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4f3cee89-cc4d-4e1e-a8cc-03cf796cd296 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.107227 Aug 29 22:50:28.353095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 504/996] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:28 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:28.455012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2304cc1a-b589-4271-b686-ecddb703a1d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:28.457499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2304cc1a-b589-4271-b686-ecddb703a1d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:28.465121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2304cc1a-b589-4271-b686-ecddb703a1d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.465672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2304cc1a-b589-4271-b686-ecddb703a1d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.465972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2304cc1a-b589-4271-b686-ecddb703a1d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.466680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2304cc1a-b589-4271-b686-ecddb703a1d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.467132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2304cc1a-b589-4271-b686-ecddb703a1d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.467557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2304cc1a-b589-4271-b686-ecddb703a1d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.502810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2304cc1a-b589-4271-b686-ecddb703a1d3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051409 Aug 29 22:50:28.503199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 493/997] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:28.595857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b27cfc63-9c27-40ea-9c92-030e4639794e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:28.598098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b27cfc63-9c27-40ea-9c92-030e4639794e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:28.604864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b27cfc63-9c27-40ea-9c92-030e4639794e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.605358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b27cfc63-9c27-40ea-9c92-030e4639794e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.605802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b27cfc63-9c27-40ea-9c92-030e4639794e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.606520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b27cfc63-9c27-40ea-9c92-030e4639794e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.606983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b27cfc63-9c27-40ea-9c92-030e4639794e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.607413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b27cfc63-9c27-40ea-9c92-030e4639794e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.643581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b27cfc63-9c27-40ea-9c92-030e4639794e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051723 Aug 29 22:50:28.644182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 505/998] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:29.354527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8ce432d4-2f65-4443-974d-9e45e8b53c32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:29.358408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8ce432d4-2f65-4443-974d-9e45e8b53c32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:29.367867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce432d4-2f65-4443-974d-9e45e8b53c32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.368511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce432d4-2f65-4443-974d-9e45e8b53c32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.368976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce432d4-2f65-4443-974d-9e45e8b53c32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.370154 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce432d4-2f65-4443-974d-9e45e8b53c32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.370949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce432d4-2f65-4443-974d-9e45e8b53c32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.371679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce432d4-2f65-4443-974d-9e45e8b53c32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.374011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:29.374886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:29.382154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.382766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.383211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.383923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.384409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.384845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.406093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8ce432d4-2f65-4443-974d-9e45e8b53c32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056816 Aug 29 22:50:29.406671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 494/999] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:29.450598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:29.460111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-85580dc9-66b1-4e47-ad5e-fec37221a287 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089963 Aug 29 22:50:29.460864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 506/1000] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:29 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:29.574071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fd8e15dc-4a76-4c75-8bea-714c59d12b2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:29.577816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fd8e15dc-4a76-4c75-8bea-714c59d12b2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:29.584205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd8e15dc-4a76-4c75-8bea-714c59d12b2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.584702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd8e15dc-4a76-4c75-8bea-714c59d12b2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.585143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd8e15dc-4a76-4c75-8bea-714c59d12b2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.585848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd8e15dc-4a76-4c75-8bea-714c59d12b2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.586310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd8e15dc-4a76-4c75-8bea-714c59d12b2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.586734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd8e15dc-4a76-4c75-8bea-714c59d12b2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.625285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fd8e15dc-4a76-4c75-8bea-714c59d12b2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111483 Aug 29 22:50:29.626005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 495/1001] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:29.658638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e3ec49ff-1c58-4166-bf95-5bf97423d6cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:29.660683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e3ec49ff-1c58-4166-bf95-5bf97423d6cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:29.668020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ec49ff-1c58-4166-bf95-5bf97423d6cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.668813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ec49ff-1c58-4166-bf95-5bf97423d6cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.668982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ec49ff-1c58-4166-bf95-5bf97423d6cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.669704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ec49ff-1c58-4166-bf95-5bf97423d6cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.670178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ec49ff-1c58-4166-bf95-5bf97423d6cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.670620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ec49ff-1c58-4166-bf95-5bf97423d6cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.704489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e3ec49ff-1c58-4166-bf95-5bf97423d6cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050048 Aug 29 22:50:29.705079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 507/1002] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:30.419570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-296b26c6-87ff-4240-afe5-d4767f29232e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:30.421985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-296b26c6-87ff-4240-afe5-d4767f29232e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:30.430551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-296b26c6-87ff-4240-afe5-d4767f29232e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.431038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-296b26c6-87ff-4240-afe5-d4767f29232e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.431501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-296b26c6-87ff-4240-afe5-d4767f29232e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.432237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-296b26c6-87ff-4240-afe5-d4767f29232e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.432691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-296b26c6-87ff-4240-afe5-d4767f29232e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.433112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-296b26c6-87ff-4240-afe5-d4767f29232e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.479792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-296b26c6-87ff-4240-afe5-d4767f29232e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064149 Aug 29 22:50:30.480753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 496/1003] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:30.484872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:30.485532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:30.493261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.494009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.494405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.495386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.496674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.497101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.570458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:30.579628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e40b09b1-a48b-49bf-9279-35e520eed9d7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.098720 Aug 29 22:50:30.580236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 508/1004] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:30 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:30.639022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9459af48-33d6-460d-8942-9a6f5516592f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:30.641346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9459af48-33d6-460d-8942-9a6f5516592f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:30.648595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9459af48-33d6-460d-8942-9a6f5516592f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.649019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9459af48-33d6-460d-8942-9a6f5516592f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.649611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9459af48-33d6-460d-8942-9a6f5516592f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.650354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9459af48-33d6-460d-8942-9a6f5516592f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.650814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9459af48-33d6-460d-8942-9a6f5516592f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.651243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9459af48-33d6-460d-8942-9a6f5516592f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.685474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9459af48-33d6-460d-8942-9a6f5516592f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050811 Aug 29 22:50:30.685988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 497/1005] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:30.719234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-25560e36-ed32-4d70-977a-79b28a53b07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:30.721494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-25560e36-ed32-4d70-977a-79b28a53b07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:30.738007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25560e36-ed32-4d70-977a-79b28a53b07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.738879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25560e36-ed32-4d70-977a-79b28a53b07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.739681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25560e36-ed32-4d70-977a-79b28a53b07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.741058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25560e36-ed32-4d70-977a-79b28a53b07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.742107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25560e36-ed32-4d70-977a-79b28a53b07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.742893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25560e36-ed32-4d70-977a-79b28a53b07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.802764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-25560e36-ed32-4d70-977a-79b28a53b07f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087232 Aug 29 22:50:30.803725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 509/1006] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:31.493560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef5b30ad-3f03-4a3c-bf98-d804a63e6117 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:31.495787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef5b30ad-3f03-4a3c-bf98-d804a63e6117 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:31.503095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef5b30ad-3f03-4a3c-bf98-d804a63e6117 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.503632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef5b30ad-3f03-4a3c-bf98-d804a63e6117 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.504106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef5b30ad-3f03-4a3c-bf98-d804a63e6117 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.504961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef5b30ad-3f03-4a3c-bf98-d804a63e6117 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.505406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef5b30ad-3f03-4a3c-bf98-d804a63e6117 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.505921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef5b30ad-3f03-4a3c-bf98-d804a63e6117 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.543752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef5b30ad-3f03-4a3c-bf98-d804a63e6117 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054369 Aug 29 22:50:31.544502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 498/1007] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:31.602491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:31.603207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:31.619459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.619459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.619459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.619459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.620052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.620052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.687526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:31.696777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8386c17a-6b0c-4faf-bb81-d0bdc23b93fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.098597 Aug 29 22:50:31.702303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 510/1008] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:31 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:31.702496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6e464df8-5a75-4ea1-b9d6-39317fe7add5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:31.702890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6e464df8-5a75-4ea1-b9d6-39317fe7add5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:31.711065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e464df8-5a75-4ea1-b9d6-39317fe7add5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.711603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e464df8-5a75-4ea1-b9d6-39317fe7add5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.712256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e464df8-5a75-4ea1-b9d6-39317fe7add5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.713408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e464df8-5a75-4ea1-b9d6-39317fe7add5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.714105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e464df8-5a75-4ea1-b9d6-39317fe7add5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.714602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e464df8-5a75-4ea1-b9d6-39317fe7add5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.719503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:31.748826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6e464df8-5a75-4ea1-b9d6-39317fe7add5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054914 Aug 29 22:50:31.749598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 499/1009] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:31.818703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8bcf6346-d5c3-4504-b87d-b7f002975651 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:31.820918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8bcf6346-d5c3-4504-b87d-b7f002975651 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:31.826874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8bcf6346-d5c3-4504-b87d-b7f002975651 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.827359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8bcf6346-d5c3-4504-b87d-b7f002975651 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.827799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8bcf6346-d5c3-4504-b87d-b7f002975651 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.828534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8bcf6346-d5c3-4504-b87d-b7f002975651 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.828999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8bcf6346-d5c3-4504-b87d-b7f002975651 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.829428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8bcf6346-d5c3-4504-b87d-b7f002975651 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.881698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8bcf6346-d5c3-4504-b87d-b7f002975651 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066735 Aug 29 22:50:31.882700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 511/1010] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:32.557752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b7b31c93-ac4a-456b-b644-5b86bdd87f47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:32.559893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b7b31c93-ac4a-456b-b644-5b86bdd87f47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:32.566578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7b31c93-ac4a-456b-b644-5b86bdd87f47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.567065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7b31c93-ac4a-456b-b644-5b86bdd87f47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.567504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7b31c93-ac4a-456b-b644-5b86bdd87f47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.568745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7b31c93-ac4a-456b-b644-5b86bdd87f47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.569224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7b31c93-ac4a-456b-b644-5b86bdd87f47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.569701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7b31c93-ac4a-456b-b644-5b86bdd87f47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.606473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b7b31c93-ac4a-456b-b644-5b86bdd87f47 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053334 Aug 29 22:50:32.607153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 500/1011] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:32.730161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:32.731301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:32.741750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.742483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.743234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.744024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.744513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.744975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.765763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-659b5523-5d11-403c-b77c-2dd6ac702a05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:32.767951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-659b5523-5d11-403c-b77c-2dd6ac702a05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:32.774869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-659b5523-5d11-403c-b77c-2dd6ac702a05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.775359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-659b5523-5d11-403c-b77c-2dd6ac702a05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.775797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-659b5523-5d11-403c-b77c-2dd6ac702a05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.776538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-659b5523-5d11-403c-b77c-2dd6ac702a05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.776994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-659b5523-5d11-403c-b77c-2dd6ac702a05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.777434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-659b5523-5d11-403c-b77c-2dd6ac702a05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.817082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:32.819520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-659b5523-5d11-403c-b77c-2dd6ac702a05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057645 Aug 29 22:50:32.820231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 501/1012] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:32.827593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b9829220-cbfb-4f76-97f6-ed180088a22c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.104868 Aug 29 22:50:32.828806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 512/1013] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:32 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:32.897515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-75da951b-e0f4-4d68-8488-de5305bc9164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:32.899990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-75da951b-e0f4-4d68-8488-de5305bc9164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:32.906716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75da951b-e0f4-4d68-8488-de5305bc9164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.912887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75da951b-e0f4-4d68-8488-de5305bc9164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.912887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75da951b-e0f4-4d68-8488-de5305bc9164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.912887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75da951b-e0f4-4d68-8488-de5305bc9164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.912887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75da951b-e0f4-4d68-8488-de5305bc9164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.913327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-75da951b-e0f4-4d68-8488-de5305bc9164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.952188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-75da951b-e0f4-4d68-8488-de5305bc9164 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059300 Aug 29 22:50:32.952994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 502/1014] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:33.621033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-07de560c-29ac-4fed-b03b-473632ab189c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:33.623181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-07de560c-29ac-4fed-b03b-473632ab189c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:33.629318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07de560c-29ac-4fed-b03b-473632ab189c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.629843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07de560c-29ac-4fed-b03b-473632ab189c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.630292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07de560c-29ac-4fed-b03b-473632ab189c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.630947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07de560c-29ac-4fed-b03b-473632ab189c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.631394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07de560c-29ac-4fed-b03b-473632ab189c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.631822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07de560c-29ac-4fed-b03b-473632ab189c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.664533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-07de560c-29ac-4fed-b03b-473632ab189c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047627 Aug 29 22:50:33.665122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 513/1015] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:33.831557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-466571d8-2eaf-42ea-ba30-a7528963d9ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:33.833713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-466571d8-2eaf-42ea-ba30-a7528963d9ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:33.845051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-466571d8-2eaf-42ea-ba30-a7528963d9ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.845536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-466571d8-2eaf-42ea-ba30-a7528963d9ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.845964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-466571d8-2eaf-42ea-ba30-a7528963d9ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.846753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-466571d8-2eaf-42ea-ba30-a7528963d9ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.847199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-466571d8-2eaf-42ea-ba30-a7528963d9ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.847622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-466571d8-2eaf-42ea-ba30-a7528963d9ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.851531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:33.852332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:33.859784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.860358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.860799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.861509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.861973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.862403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.882036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-466571d8-2eaf-42ea-ba30-a7528963d9ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054125 Aug 29 22:50:33.882558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 503/1016] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:33.941273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:33.952336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8978f73b-8014-4e32-a63d-2af27b2e9c51 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.104706 Aug 29 22:50:33.952932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 514/1017] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:33 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:33.967659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-14beae26-b953-4c54-8ea2-50a10f0cf580 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:33.969859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-14beae26-b953-4c54-8ea2-50a10f0cf580 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:33.976977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14beae26-b953-4c54-8ea2-50a10f0cf580 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.977461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14beae26-b953-4c54-8ea2-50a10f0cf580 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.977897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14beae26-b953-4c54-8ea2-50a10f0cf580 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.978593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14beae26-b953-4c54-8ea2-50a10f0cf580 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.979042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14beae26-b953-4c54-8ea2-50a10f0cf580 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.979464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14beae26-b953-4c54-8ea2-50a10f0cf580 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:34.014738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-14beae26-b953-4c54-8ea2-50a10f0cf580 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051855 Aug 29 22:50:34.015314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 504/1018] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:34.678340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7d56b635-2465-4360-9880-4656a6a156ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:34.680603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7d56b635-2465-4360-9880-4656a6a156ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:34.689266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d56b635-2465-4360-9880-4656a6a156ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:34.689753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d56b635-2465-4360-9880-4656a6a156ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:34.690183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d56b635-2465-4360-9880-4656a6a156ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:34.690894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d56b635-2465-4360-9880-4656a6a156ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:34.691339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d56b635-2465-4360-9880-4656a6a156ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:34.691791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d56b635-2465-4360-9880-4656a6a156ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:34.731724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7d56b635-2465-4360-9880-4656a6a156ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058068 Aug 29 22:50:34.732333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 515/1019] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:34.898450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-44c46f8e-cd9b-459b-8c79-a09a0878226a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:34.901022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-44c46f8e-cd9b-459b-8c79-a09a0878226a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:34.908061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44c46f8e-cd9b-459b-8c79-a09a0878226a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:34.908647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44c46f8e-cd9b-459b-8c79-a09a0878226a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:34.909076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44c46f8e-cd9b-459b-8c79-a09a0878226a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:34.909791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44c46f8e-cd9b-459b-8c79-a09a0878226a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:34.910248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44c46f8e-cd9b-459b-8c79-a09a0878226a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:34.910664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44c46f8e-cd9b-459b-8c79-a09a0878226a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:34.951435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-44c46f8e-cd9b-459b-8c79-a09a0878226a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057092 Aug 29 22:50:34.952073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 505/1020] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:34.975749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:34.976441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:34.983851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:34.984397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:34.984834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:34.985540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:34.986053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:34.986475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.032214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ded1c43e-50e6-4500-b4f4-516cde8c15d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:35.035687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ded1c43e-50e6-4500-b4f4-516cde8c15d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:35.043105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ded1c43e-50e6-4500-b4f4-516cde8c15d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.043593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ded1c43e-50e6-4500-b4f4-516cde8c15d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.044024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ded1c43e-50e6-4500-b4f4-516cde8c15d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.044784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ded1c43e-50e6-4500-b4f4-516cde8c15d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.045232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ded1c43e-50e6-4500-b4f4-516cde8c15d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.045650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ded1c43e-50e6-4500-b4f4-516cde8c15d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.058384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:35.066466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-09f07c10-8bdf-4174-acda-323e7fcf86e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.095513 Aug 29 22:50:35.067291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 516/1021] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:34 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:35.090926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ded1c43e-50e6-4500-b4f4-516cde8c15d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066047 Aug 29 22:50:35.091755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 506/1022] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:35.745434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e7bbe462-aa7c-46e7-9bd4-95c120c7a84c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:35.747234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e7bbe462-aa7c-46e7-9bd4-95c120c7a84c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:35.753321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7bbe462-aa7c-46e7-9bd4-95c120c7a84c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.753834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7bbe462-aa7c-46e7-9bd4-95c120c7a84c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.754273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7bbe462-aa7c-46e7-9bd4-95c120c7a84c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.754966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7bbe462-aa7c-46e7-9bd4-95c120c7a84c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.755417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7bbe462-aa7c-46e7-9bd4-95c120c7a84c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.755868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7bbe462-aa7c-46e7-9bd4-95c120c7a84c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.789379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e7bbe462-aa7c-46e7-9bd4-95c120c7a84c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048791 Aug 29 22:50:35.789952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 517/1023] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:35.964299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e15227f8-bfde-4a49-a5e7-9b65b679c063 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:35.966570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e15227f8-bfde-4a49-a5e7-9b65b679c063 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:35.973374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e15227f8-bfde-4a49-a5e7-9b65b679c063 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.973931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e15227f8-bfde-4a49-a5e7-9b65b679c063 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.974609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e15227f8-bfde-4a49-a5e7-9b65b679c063 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.975535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e15227f8-bfde-4a49-a5e7-9b65b679c063 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.976159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e15227f8-bfde-4a49-a5e7-9b65b679c063 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.976599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e15227f8-bfde-4a49-a5e7-9b65b679c063 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.013467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e15227f8-bfde-4a49-a5e7-9b65b679c063 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053085 Aug 29 22:50:36.014045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 507/1024] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:36.088222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:36.088864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:36.095583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.096068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.096552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.097253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.098087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.098280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.105726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-317b5bed-090c-4a19-a073-a6322fc4abff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:36.109036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-317b5bed-090c-4a19-a073-a6322fc4abff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:36.117564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-317b5bed-090c-4a19-a073-a6322fc4abff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.118082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-317b5bed-090c-4a19-a073-a6322fc4abff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.118524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-317b5bed-090c-4a19-a073-a6322fc4abff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.119284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-317b5bed-090c-4a19-a073-a6322fc4abff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.119758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-317b5bed-090c-4a19-a073-a6322fc4abff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.120224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-317b5bed-090c-4a19-a073-a6322fc4abff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.165082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-317b5bed-090c-4a19-a073-a6322fc4abff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065715 Aug 29 22:50:36.165671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 508/1025] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:36.192690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:36.200705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7808277a-9ba3-4bb7-b993-8ea933cedeec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.116811 Aug 29 22:50:36.201315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 518/1026] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:36 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:36.802050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ce9d13b7-af8d-42ed-b85c-76fcc8c8841a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:36.804630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ce9d13b7-af8d-42ed-b85c-76fcc8c8841a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:36.811015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce9d13b7-af8d-42ed-b85c-76fcc8c8841a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.811498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce9d13b7-af8d-42ed-b85c-76fcc8c8841a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.811932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce9d13b7-af8d-42ed-b85c-76fcc8c8841a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.812681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce9d13b7-af8d-42ed-b85c-76fcc8c8841a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.813131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce9d13b7-af8d-42ed-b85c-76fcc8c8841a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.813550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce9d13b7-af8d-42ed-b85c-76fcc8c8841a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.850903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ce9d13b7-af8d-42ed-b85c-76fcc8c8841a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052666 Aug 29 22:50:36.851523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 509/1027] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:37.027240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b567e07c-0caf-4a91-a25c-dba9a7b73a7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:37.029483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b567e07c-0caf-4a91-a25c-dba9a7b73a7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:37.035721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b567e07c-0caf-4a91-a25c-dba9a7b73a7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.036399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b567e07c-0caf-4a91-a25c-dba9a7b73a7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.036677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b567e07c-0caf-4a91-a25c-dba9a7b73a7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.037356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b567e07c-0caf-4a91-a25c-dba9a7b73a7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.037700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b567e07c-0caf-4a91-a25c-dba9a7b73a7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.038132 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b567e07c-0caf-4a91-a25c-dba9a7b73a7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.072965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b567e07c-0caf-4a91-a25c-dba9a7b73a7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049512 Aug 29 22:50:37.073565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 519/1028] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:37.178334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2fe559d3-614e-4179-8289-0194a9aa4d84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:37.180772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2fe559d3-614e-4179-8289-0194a9aa4d84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:37.187588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe559d3-614e-4179-8289-0194a9aa4d84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.188175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe559d3-614e-4179-8289-0194a9aa4d84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.188615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe559d3-614e-4179-8289-0194a9aa4d84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.189319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe559d3-614e-4179-8289-0194a9aa4d84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.189895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe559d3-614e-4179-8289-0194a9aa4d84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.190324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe559d3-614e-4179-8289-0194a9aa4d84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.223790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:37.224463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2fe559d3-614e-4179-8289-0194a9aa4d84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050351 Aug 29 22:50:37.224838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 510/1029] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:37.224941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:37.232455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.232942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.233450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.234147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.234633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.235075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.305679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:37.316315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cc4e315c-d230-4608-92f7-be992bb57616 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.097416 Aug 29 22:50:37.316909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 520/1030] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:37 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:37.867100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1100b968-2af4-485a-b05b-0ffdf4986fc8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:37.869386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1100b968-2af4-485a-b05b-0ffdf4986fc8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:37.875681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1100b968-2af4-485a-b05b-0ffdf4986fc8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.876183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1100b968-2af4-485a-b05b-0ffdf4986fc8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.876620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1100b968-2af4-485a-b05b-0ffdf4986fc8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.877310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1100b968-2af4-485a-b05b-0ffdf4986fc8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.877754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1100b968-2af4-485a-b05b-0ffdf4986fc8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.878168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1100b968-2af4-485a-b05b-0ffdf4986fc8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.911009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1100b968-2af4-485a-b05b-0ffdf4986fc8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048748 Aug 29 22:50:37.911707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 511/1031] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:38.089288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b85d722e-e03e-4a23-900d-87828dfdaccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:38.092716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b85d722e-e03e-4a23-900d-87828dfdaccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:38.103042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85d722e-e03e-4a23-900d-87828dfdaccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.103772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85d722e-e03e-4a23-900d-87828dfdaccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.104488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85d722e-e03e-4a23-900d-87828dfdaccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.105574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85d722e-e03e-4a23-900d-87828dfdaccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.106294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85d722e-e03e-4a23-900d-87828dfdaccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.106929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85d722e-e03e-4a23-900d-87828dfdaccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.111349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:38.145225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b85d722e-e03e-4a23-900d-87828dfdaccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063348 Aug 29 22:50:38.145808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 521/1032] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:38.237168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0897d7bc-b10a-441f-bf1b-8b4e37752c28 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:38.239393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0897d7bc-b10a-441f-bf1b-8b4e37752c28 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:38.246672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0897d7bc-b10a-441f-bf1b-8b4e37752c28 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.247152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0897d7bc-b10a-441f-bf1b-8b4e37752c28 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.247585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0897d7bc-b10a-441f-bf1b-8b4e37752c28 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.248319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0897d7bc-b10a-441f-bf1b-8b4e37752c28 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.248825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0897d7bc-b10a-441f-bf1b-8b4e37752c28 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.249186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0897d7bc-b10a-441f-bf1b-8b4e37752c28 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.280910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0897d7bc-b10a-441f-bf1b-8b4e37752c28 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047668 Aug 29 22:50:38.281486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 512/1033] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:38.338844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:38.339537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:38.341875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:38.346923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.347415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.347847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.348585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.349029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.349949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.416958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:38.426806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-832530d7-2130-499a-93cf-346d8d09e04d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092015 Aug 29 22:50:38.427467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 522/1034] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:38 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:38.923811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f37c1128-056c-4a4c-9a4c-ad2d7550df61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:38.926081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f37c1128-056c-4a4c-9a4c-ad2d7550df61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:38.933117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f37c1128-056c-4a4c-9a4c-ad2d7550df61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.933654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f37c1128-056c-4a4c-9a4c-ad2d7550df61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.934127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f37c1128-056c-4a4c-9a4c-ad2d7550df61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.934869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f37c1128-056c-4a4c-9a4c-ad2d7550df61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.935321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f37c1128-056c-4a4c-9a4c-ad2d7550df61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.935750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f37c1128-056c-4a4c-9a4c-ad2d7550df61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.967958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f37c1128-056c-4a4c-9a4c-ad2d7550df61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048285 Aug 29 22:50:38.968572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 513/1035] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:39.157607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-951447ee-82bb-4842-a4c0-9df662ed9993 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:39.159676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-951447ee-82bb-4842-a4c0-9df662ed9993 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:39.168855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-951447ee-82bb-4842-a4c0-9df662ed9993 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.169340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-951447ee-82bb-4842-a4c0-9df662ed9993 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.169771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-951447ee-82bb-4842-a4c0-9df662ed9993 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.170476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-951447ee-82bb-4842-a4c0-9df662ed9993 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.171088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-951447ee-82bb-4842-a4c0-9df662ed9993 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.171347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-951447ee-82bb-4842-a4c0-9df662ed9993 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.202724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-951447ee-82bb-4842-a4c0-9df662ed9993 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049076 Aug 29 22:50:39.203302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 523/1036] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:39.293876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f7cbce92-079a-4d0f-ba9d-5addbcd1ac9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:39.296129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f7cbce92-079a-4d0f-ba9d-5addbcd1ac9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:39.303451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7cbce92-079a-4d0f-ba9d-5addbcd1ac9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.303950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7cbce92-079a-4d0f-ba9d-5addbcd1ac9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.304426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7cbce92-079a-4d0f-ba9d-5addbcd1ac9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.305487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7cbce92-079a-4d0f-ba9d-5addbcd1ac9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.306141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7cbce92-079a-4d0f-ba9d-5addbcd1ac9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.306746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7cbce92-079a-4d0f-ba9d-5addbcd1ac9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.344488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f7cbce92-079a-4d0f-ba9d-5addbcd1ac9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054647 Aug 29 22:50:39.345069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 514/1037] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:39.453950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:39.455114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:39.467932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.468876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.469635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.471246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.472110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.472878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.545866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:39.555176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f0a77f58-df58-45f4-997f-0d3bc0b3bc61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.108719 Aug 29 22:50:39.556054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 524/1038] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:39 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:39.981204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-019958a4-b37a-4a90-ba78-fb735a11a55d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:39.983380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-019958a4-b37a-4a90-ba78-fb735a11a55d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:39.985416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:39.990818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019958a4-b37a-4a90-ba78-fb735a11a55d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.991417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019958a4-b37a-4a90-ba78-fb735a11a55d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.994936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019958a4-b37a-4a90-ba78-fb735a11a55d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.994936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019958a4-b37a-4a90-ba78-fb735a11a55d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.994936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019958a4-b37a-4a90-ba78-fb735a11a55d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.994936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019958a4-b37a-4a90-ba78-fb735a11a55d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.023234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:40.028060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-019958a4-b37a-4a90-ba78-fb735a11a55d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050928 Aug 29 22:50:40.028688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 515/1039] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:40.217075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-71378ce4-dca6-4862-b581-ba1b9bdb87a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:40.219683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-71378ce4-dca6-4862-b581-ba1b9bdb87a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:40.227141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71378ce4-dca6-4862-b581-ba1b9bdb87a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.227631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71378ce4-dca6-4862-b581-ba1b9bdb87a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.228088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71378ce4-dca6-4862-b581-ba1b9bdb87a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.228838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71378ce4-dca6-4862-b581-ba1b9bdb87a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.229308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71378ce4-dca6-4862-b581-ba1b9bdb87a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.229731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71378ce4-dca6-4862-b581-ba1b9bdb87a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.262507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-71378ce4-dca6-4862-b581-ba1b9bdb87a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050667 Aug 29 22:50:40.263091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 525/1040] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:40 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:40.357516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2b31a8be-358d-4bf3-93ae-66ceba1e3e8e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:40.359590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2b31a8be-358d-4bf3-93ae-66ceba1e3e8e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:40.367237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b31a8be-358d-4bf3-93ae-66ceba1e3e8e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.367725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b31a8be-358d-4bf3-93ae-66ceba1e3e8e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.368286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b31a8be-358d-4bf3-93ae-66ceba1e3e8e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.369295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b31a8be-358d-4bf3-93ae-66ceba1e3e8e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.369447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b31a8be-358d-4bf3-93ae-66ceba1e3e8e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.369785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b31a8be-358d-4bf3-93ae-66ceba1e3e8e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.407279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2b31a8be-358d-4bf3-93ae-66ceba1e3e8e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054142 Aug 29 22:50:40.407868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 516/1041] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:40.579837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:40.581132 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:40.591530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.592262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.592820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.593672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.594431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.595475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.676988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:40.686111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-250f0439-fdb3-4f83-9163-94a9b83257e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.111482 Aug 29 22:50:40.686691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 526/1042] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:40 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:41.041783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4437086c-e4ec-45b5-80d6-a6bd37b226e5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:41.043965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4437086c-e4ec-45b5-80d6-a6bd37b226e5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:41.050565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4437086c-e4ec-45b5-80d6-a6bd37b226e5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.051065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4437086c-e4ec-45b5-80d6-a6bd37b226e5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.051496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4437086c-e4ec-45b5-80d6-a6bd37b226e5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.052246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4437086c-e4ec-45b5-80d6-a6bd37b226e5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.052738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4437086c-e4ec-45b5-80d6-a6bd37b226e5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.053165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4437086c-e4ec-45b5-80d6-a6bd37b226e5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.090218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4437086c-e4ec-45b5-80d6-a6bd37b226e5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053210 Aug 29 22:50:41.090834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 517/1043] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:41.276150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0e251ae7-d90c-4511-afc4-0e166a91a3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:41.278341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0e251ae7-d90c-4511-afc4-0e166a91a3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:41.284509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e251ae7-d90c-4511-afc4-0e166a91a3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.285024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e251ae7-d90c-4511-afc4-0e166a91a3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.285467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e251ae7-d90c-4511-afc4-0e166a91a3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.286187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e251ae7-d90c-4511-afc4-0e166a91a3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.286657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e251ae7-d90c-4511-afc4-0e166a91a3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.287632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e251ae7-d90c-4511-afc4-0e166a91a3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.333426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0e251ae7-d90c-4511-afc4-0e166a91a3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061827 Aug 29 22:50:41.334493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 527/1044] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:41.420432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-adde7403-845d-42fc-b5b4-c22e8a51e202 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:41.422635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-adde7403-845d-42fc-b5b4-c22e8a51e202 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:41.429746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adde7403-845d-42fc-b5b4-c22e8a51e202 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.430480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adde7403-845d-42fc-b5b4-c22e8a51e202 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.430799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adde7403-845d-42fc-b5b4-c22e8a51e202 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.431921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adde7403-845d-42fc-b5b4-c22e8a51e202 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.432755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adde7403-845d-42fc-b5b4-c22e8a51e202 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.433507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adde7403-845d-42fc-b5b4-c22e8a51e202 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.471418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-adde7403-845d-42fc-b5b4-c22e8a51e202 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055387 Aug 29 22:50:41.472009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 518/1045] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:41.708058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:41.708754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:41.715582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.716074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.716544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.717250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.717710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.718131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.787627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:41.797063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b17a5e1a-fd9e-406a-a9c2-89f0297f57cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093527 Aug 29 22:50:41.797752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 528/1046] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:41 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:42.104003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ed5dc120-dea5-4a0d-aa20-7478f8948784 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:42.106117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ed5dc120-dea5-4a0d-aa20-7478f8948784 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:42.112682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed5dc120-dea5-4a0d-aa20-7478f8948784 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.113167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed5dc120-dea5-4a0d-aa20-7478f8948784 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.113597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed5dc120-dea5-4a0d-aa20-7478f8948784 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.114309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed5dc120-dea5-4a0d-aa20-7478f8948784 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.114760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed5dc120-dea5-4a0d-aa20-7478f8948784 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.115231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed5dc120-dea5-4a0d-aa20-7478f8948784 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.148838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ed5dc120-dea5-4a0d-aa20-7478f8948784 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049318 Aug 29 22:50:42.149423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 519/1047] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:42.345903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d8ffa761-956f-4efd-99b5-eb074d77f4ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:42.348168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d8ffa761-956f-4efd-99b5-eb074d77f4ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:42.354554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8ffa761-956f-4efd-99b5-eb074d77f4ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.354956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8ffa761-956f-4efd-99b5-eb074d77f4ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.355389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8ffa761-956f-4efd-99b5-eb074d77f4ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.356112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8ffa761-956f-4efd-99b5-eb074d77f4ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.356593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8ffa761-956f-4efd-99b5-eb074d77f4ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.357008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8ffa761-956f-4efd-99b5-eb074d77f4ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.389213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d8ffa761-956f-4efd-99b5-eb074d77f4ec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047270 Aug 29 22:50:42.389785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 529/1048] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:42.483671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1cb59643-2e08-46dc-9894-c56e163c06f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:42.485990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1cb59643-2e08-46dc-9894-c56e163c06f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:42.494079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cb59643-2e08-46dc-9894-c56e163c06f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.494574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cb59643-2e08-46dc-9894-c56e163c06f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.495008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cb59643-2e08-46dc-9894-c56e163c06f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.495776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cb59643-2e08-46dc-9894-c56e163c06f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.496267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cb59643-2e08-46dc-9894-c56e163c06f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.496719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1cb59643-2e08-46dc-9894-c56e163c06f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.529208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1cb59643-2e08-46dc-9894-c56e163c06f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049411 Aug 29 22:50:42.529792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 520/1049] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:42.819386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:42.819977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:42.829764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.830622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.831648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.833042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.833979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.835831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.908616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:42.920926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bba66ae0-c2f5-4a12-819a-9d3722f62af8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.105232 Aug 29 22:50:42.925199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 530/1050] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:42 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:43.161697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b7350d0b-0c9d-4155-a57a-dc41cd4d6fd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:43.165001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b7350d0b-0c9d-4155-a57a-dc41cd4d6fd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:43.171573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7350d0b-0c9d-4155-a57a-dc41cd4d6fd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.172061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7350d0b-0c9d-4155-a57a-dc41cd4d6fd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.172629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7350d0b-0c9d-4155-a57a-dc41cd4d6fd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.174355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7350d0b-0c9d-4155-a57a-dc41cd4d6fd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.174818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7350d0b-0c9d-4155-a57a-dc41cd4d6fd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.175273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7350d0b-0c9d-4155-a57a-dc41cd4d6fd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.212939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b7350d0b-0c9d-4155-a57a-dc41cd4d6fd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055384 Aug 29 22:50:43.213536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 521/1051] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:43.404583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-38fba24d-5108-479f-88d2-c0ad0cb9983b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:43.408660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38fba24d-5108-479f-88d2-c0ad0cb9983b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:43.417171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38fba24d-5108-479f-88d2-c0ad0cb9983b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.417536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38fba24d-5108-479f-88d2-c0ad0cb9983b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.417976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38fba24d-5108-479f-88d2-c0ad0cb9983b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.418847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38fba24d-5108-479f-88d2-c0ad0cb9983b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.419308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38fba24d-5108-479f-88d2-c0ad0cb9983b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.419745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38fba24d-5108-479f-88d2-c0ad0cb9983b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.454950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-38fba24d-5108-479f-88d2-c0ad0cb9983b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054554 Aug 29 22:50:43.455521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 531/1052] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:43.543080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef2bab7a-6c65-4ec6-8678-3a452126eff0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:43.546869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef2bab7a-6c65-4ec6-8678-3a452126eff0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:43.557498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef2bab7a-6c65-4ec6-8678-3a452126eff0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.558224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef2bab7a-6c65-4ec6-8678-3a452126eff0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.559013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef2bab7a-6c65-4ec6-8678-3a452126eff0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.560321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef2bab7a-6c65-4ec6-8678-3a452126eff0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.561162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef2bab7a-6c65-4ec6-8678-3a452126eff0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.561927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef2bab7a-6c65-4ec6-8678-3a452126eff0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.607832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef2bab7a-6c65-4ec6-8678-3a452126eff0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069599 Aug 29 22:50:43.608620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 522/1053] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:43.949387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:43.950228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:43.957738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.958594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.959870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.961460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.962248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.962997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.032452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:44.041989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eac7f17e-29dc-41e4-85a4-a8c9c183b3ac tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.098017 Aug 29 22:50:44.042712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 532/1054] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:43 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:44.230370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f5ebf076-84a6-49ef-9b23-7d1af9e64785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:44.232875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f5ebf076-84a6-49ef-9b23-7d1af9e64785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:44.239937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5ebf076-84a6-49ef-9b23-7d1af9e64785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.240540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5ebf076-84a6-49ef-9b23-7d1af9e64785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.241027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5ebf076-84a6-49ef-9b23-7d1af9e64785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.241794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5ebf076-84a6-49ef-9b23-7d1af9e64785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.242626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5ebf076-84a6-49ef-9b23-7d1af9e64785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.242834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5ebf076-84a6-49ef-9b23-7d1af9e64785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.277195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f5ebf076-84a6-49ef-9b23-7d1af9e64785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050873 Aug 29 22:50:44.277784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 523/1055] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:44.473586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-53186dd3-3ded-4c99-a29a-5704c1025321 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:44.476499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-53186dd3-3ded-4c99-a29a-5704c1025321 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:44.483232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-53186dd3-3ded-4c99-a29a-5704c1025321 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.483721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-53186dd3-3ded-4c99-a29a-5704c1025321 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.484183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-53186dd3-3ded-4c99-a29a-5704c1025321 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.484908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-53186dd3-3ded-4c99-a29a-5704c1025321 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.485361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-53186dd3-3ded-4c99-a29a-5704c1025321 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.485868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-53186dd3-3ded-4c99-a29a-5704c1025321 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.531728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-53186dd3-3ded-4c99-a29a-5704c1025321 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062426 Aug 29 22:50:44.532342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 533/1056] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:44.625720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-722869ee-bd9a-4863-862a-20c8b65daa8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:44.627923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-722869ee-bd9a-4863-862a-20c8b65daa8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:44.638348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-722869ee-bd9a-4863-862a-20c8b65daa8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.638842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-722869ee-bd9a-4863-862a-20c8b65daa8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.639282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-722869ee-bd9a-4863-862a-20c8b65daa8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.640009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-722869ee-bd9a-4863-862a-20c8b65daa8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.640552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-722869ee-bd9a-4863-862a-20c8b65daa8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.640982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-722869ee-bd9a-4863-862a-20c8b65daa8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.675579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-722869ee-bd9a-4863-862a-20c8b65daa8f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055188 Aug 29 22:50:44.676167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 524/1057] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:45.064735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:45.065613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:45.075989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.076570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.077059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.077899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.078466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.079015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.177528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:45.189908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8c29b20e-3bb5-4995-9cf0-7da00107b3b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.130321 Aug 29 22:50:45.192391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 534/1058] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:45 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:45.290614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-196c13a1-aebd-49e9-a5e1-5d1f85703edc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:45.293852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-196c13a1-aebd-49e9-a5e1-5d1f85703edc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:45.303977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-196c13a1-aebd-49e9-a5e1-5d1f85703edc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.305775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-196c13a1-aebd-49e9-a5e1-5d1f85703edc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.305983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-196c13a1-aebd-49e9-a5e1-5d1f85703edc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.307644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-196c13a1-aebd-49e9-a5e1-5d1f85703edc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.308924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-196c13a1-aebd-49e9-a5e1-5d1f85703edc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.309685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-196c13a1-aebd-49e9-a5e1-5d1f85703edc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.360093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-196c13a1-aebd-49e9-a5e1-5d1f85703edc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073477 Aug 29 22:50:45.360795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 525/1059] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:45.549589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1d7dba04-ed07-4a88-9ce6-a3aacf39d50e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:45.554383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1d7dba04-ed07-4a88-9ce6-a3aacf39d50e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:45.565998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d7dba04-ed07-4a88-9ce6-a3aacf39d50e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.566887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d7dba04-ed07-4a88-9ce6-a3aacf39d50e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.567689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d7dba04-ed07-4a88-9ce6-a3aacf39d50e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.569856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d7dba04-ed07-4a88-9ce6-a3aacf39d50e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.570727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d7dba04-ed07-4a88-9ce6-a3aacf39d50e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.571667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d7dba04-ed07-4a88-9ce6-a3aacf39d50e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.628561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1d7dba04-ed07-4a88-9ce6-a3aacf39d50e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086214 Aug 29 22:50:45.629333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 535/1060] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:45.697863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-69114340-a3c9-4d68-a583-d55291a726ee tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:45.701650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-69114340-a3c9-4d68-a583-d55291a726ee tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:45.714993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69114340-a3c9-4d68-a583-d55291a726ee tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.715862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69114340-a3c9-4d68-a583-d55291a726ee tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.716651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69114340-a3c9-4d68-a583-d55291a726ee tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.717492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69114340-a3c9-4d68-a583-d55291a726ee tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.718362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69114340-a3c9-4d68-a583-d55291a726ee tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.719133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69114340-a3c9-4d68-a583-d55291a726ee tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.773134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-69114340-a3c9-4d68-a583-d55291a726ee tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084891 Aug 29 22:50:45.773827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 526/1061] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:46.220312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:46.220929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:46.227992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.228625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.229285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.230136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.230594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.231017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.300373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:46.309356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3e8f8a90-191e-4cb4-ab82-9fe4c0c52e9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092835 Aug 29 22:50:46.309948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 536/1062] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:46 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:46.377056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-58c6686c-93ce-4b90-afbe-aa285c5117ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:46.381778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-58c6686c-93ce-4b90-afbe-aa285c5117ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:46.392949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58c6686c-93ce-4b90-afbe-aa285c5117ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.393823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58c6686c-93ce-4b90-afbe-aa285c5117ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.394617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58c6686c-93ce-4b90-afbe-aa285c5117ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.395888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58c6686c-93ce-4b90-afbe-aa285c5117ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.397346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58c6686c-93ce-4b90-afbe-aa285c5117ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.398047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58c6686c-93ce-4b90-afbe-aa285c5117ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.444953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-58c6686c-93ce-4b90-afbe-aa285c5117ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075434 Aug 29 22:50:46.445596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 527/1063] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:46.647509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ed12eab3-f45c-4db5-ae12-d6070ce4509f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:46.651364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ed12eab3-f45c-4db5-ae12-d6070ce4509f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:46.662435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed12eab3-f45c-4db5-ae12-d6070ce4509f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.663321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed12eab3-f45c-4db5-ae12-d6070ce4509f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.664116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed12eab3-f45c-4db5-ae12-d6070ce4509f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.665459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed12eab3-f45c-4db5-ae12-d6070ce4509f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.666302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed12eab3-f45c-4db5-ae12-d6070ce4509f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.667058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed12eab3-f45c-4db5-ae12-d6070ce4509f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.700325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:46.711424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ed12eab3-f45c-4db5-ae12-d6070ce4509f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072235 Aug 29 22:50:46.711967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 537/1064] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:46.788772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-37458a76-f2c5-48fc-ad86-eb1c79edc018 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:46.792488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-37458a76-f2c5-48fc-ad86-eb1c79edc018 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:46.800167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37458a76-f2c5-48fc-ad86-eb1c79edc018 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.800653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37458a76-f2c5-48fc-ad86-eb1c79edc018 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.801092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37458a76-f2c5-48fc-ad86-eb1c79edc018 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.802130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37458a76-f2c5-48fc-ad86-eb1c79edc018 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.803242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37458a76-f2c5-48fc-ad86-eb1c79edc018 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.803575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37458a76-f2c5-48fc-ad86-eb1c79edc018 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.838977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-37458a76-f2c5-48fc-ad86-eb1c79edc018 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057604 Aug 29 22:50:46.839895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 528/1065] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:46 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:47.340045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:47.340973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:47.353876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.354595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.357574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.360473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.362759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.363561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.469666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3f1cf6ab-62df-4cd7-88e5-bcc8cbd26a71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:47.473557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3f1cf6ab-62df-4cd7-88e5-bcc8cbd26a71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:47.483603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f1cf6ab-62df-4cd7-88e5-bcc8cbd26a71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.483603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f1cf6ab-62df-4cd7-88e5-bcc8cbd26a71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.483946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f1cf6ab-62df-4cd7-88e5-bcc8cbd26a71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.484735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f1cf6ab-62df-4cd7-88e5-bcc8cbd26a71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.485321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:47.485450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f1cf6ab-62df-4cd7-88e5-bcc8cbd26a71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.485926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f1cf6ab-62df-4cd7-88e5-bcc8cbd26a71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.495206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1772ddcc-069f-49da-83c7-117d8c3d4d9d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.159910 Aug 29 22:50:47.497034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 538/1066] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:47 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:47.534495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3f1cf6ab-62df-4cd7-88e5-bcc8cbd26a71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078230 Aug 29 22:50:47.535016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 529/1067] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:47.723927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-66a00e4c-6d2c-402c-a5c2-a7f9ae5d44fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:47.726814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-66a00e4c-6d2c-402c-a5c2-a7f9ae5d44fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:47.733789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a00e4c-6d2c-402c-a5c2-a7f9ae5d44fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.734283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a00e4c-6d2c-402c-a5c2-a7f9ae5d44fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.734723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a00e4c-6d2c-402c-a5c2-a7f9ae5d44fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.735437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a00e4c-6d2c-402c-a5c2-a7f9ae5d44fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.735892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a00e4c-6d2c-402c-a5c2-a7f9ae5d44fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.736357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a00e4c-6d2c-402c-a5c2-a7f9ae5d44fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.782389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-66a00e4c-6d2c-402c-a5c2-a7f9ae5d44fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062295 Aug 29 22:50:47.783496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 539/1068] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:47.859554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a25dd6f4-8d16-4931-b2fd-5850c2d3e648 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:47.861764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a25dd6f4-8d16-4931-b2fd-5850c2d3e648 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:47.869781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a25dd6f4-8d16-4931-b2fd-5850c2d3e648 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.870336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a25dd6f4-8d16-4931-b2fd-5850c2d3e648 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.870832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a25dd6f4-8d16-4931-b2fd-5850c2d3e648 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.871617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a25dd6f4-8d16-4931-b2fd-5850c2d3e648 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.872130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a25dd6f4-8d16-4931-b2fd-5850c2d3e648 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.872659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a25dd6f4-8d16-4931-b2fd-5850c2d3e648 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.911147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a25dd6f4-8d16-4931-b2fd-5850c2d3e648 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056215 Aug 29 22:50:47.911884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 530/1069] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:48.522304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:48.523474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:48.534464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.535305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.536059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.538249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.539049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.539792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.547446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-22637713-e7c5-4ea4-a98a-9a1dd36e5ff5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:48.550352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-22637713-e7c5-4ea4-a98a-9a1dd36e5ff5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:48.561024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22637713-e7c5-4ea4-a98a-9a1dd36e5ff5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.562285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22637713-e7c5-4ea4-a98a-9a1dd36e5ff5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.562599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22637713-e7c5-4ea4-a98a-9a1dd36e5ff5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.563854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22637713-e7c5-4ea4-a98a-9a1dd36e5ff5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.564696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22637713-e7c5-4ea4-a98a-9a1dd36e5ff5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.565481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22637713-e7c5-4ea4-a98a-9a1dd36e5ff5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.617886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-22637713-e7c5-4ea4-a98a-9a1dd36e5ff5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074300 Aug 29 22:50:48.618469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 531/1070] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:48.634704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:48.643055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-586827db-f6a0-4876-a2b8-abb8a53e8a0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.128506 Aug 29 22:50:48.643657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 540/1071] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:48 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:48.797406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-042b3e68-c581-4e4b-a992-bf447e291801 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:48.799540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-042b3e68-c581-4e4b-a992-bf447e291801 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:48.806125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-042b3e68-c581-4e4b-a992-bf447e291801 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.806602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-042b3e68-c581-4e4b-a992-bf447e291801 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.807030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-042b3e68-c581-4e4b-a992-bf447e291801 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.807720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-042b3e68-c581-4e4b-a992-bf447e291801 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.808195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-042b3e68-c581-4e4b-a992-bf447e291801 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.808609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-042b3e68-c581-4e4b-a992-bf447e291801 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.826250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:48.840894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-042b3e68-c581-4e4b-a992-bf447e291801 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048249 Aug 29 22:50:48.846336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 532/1072] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:48.928841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-296aaf9e-bf92-4c5f-8871-af6d470aa161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:48.932824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-296aaf9e-bf92-4c5f-8871-af6d470aa161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:48.943557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296aaf9e-bf92-4c5f-8871-af6d470aa161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.944505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296aaf9e-bf92-4c5f-8871-af6d470aa161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.945328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296aaf9e-bf92-4c5f-8871-af6d470aa161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.946613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296aaf9e-bf92-4c5f-8871-af6d470aa161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.947298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296aaf9e-bf92-4c5f-8871-af6d470aa161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.947740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296aaf9e-bf92-4c5f-8871-af6d470aa161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.134972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-296aaf9e-bf92-4c5f-8871-af6d470aa161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212785 Aug 29 22:50:49.135552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 541/1073] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:49.635157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-186ae9c6-3577-4275-a5cd-7828f50ae82d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:49.637709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-186ae9c6-3577-4275-a5cd-7828f50ae82d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:49.645077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-186ae9c6-3577-4275-a5cd-7828f50ae82d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.645572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-186ae9c6-3577-4275-a5cd-7828f50ae82d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.646871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-186ae9c6-3577-4275-a5cd-7828f50ae82d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.647829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-186ae9c6-3577-4275-a5cd-7828f50ae82d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.648396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-186ae9c6-3577-4275-a5cd-7828f50ae82d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.648793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-186ae9c6-3577-4275-a5cd-7828f50ae82d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.671082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:49.672129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:49.684506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.685009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.685487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.686325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.687141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.687870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.697449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-186ae9c6-3577-4275-a5cd-7828f50ae82d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067040 Aug 29 22:50:49.698439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 533/1074] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:49.802235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:49.812123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9c36d87f-c034-4b5b-aff6-4203373900d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.149996 Aug 29 22:50:49.812821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 542/1075] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:49 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:49.859210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6faaa5f8-9d91-4177-bc1d-069b935a3e82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:49.861458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6faaa5f8-9d91-4177-bc1d-069b935a3e82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:49.869786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6faaa5f8-9d91-4177-bc1d-069b935a3e82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.870283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6faaa5f8-9d91-4177-bc1d-069b935a3e82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.870715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6faaa5f8-9d91-4177-bc1d-069b935a3e82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.871419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6faaa5f8-9d91-4177-bc1d-069b935a3e82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.871874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6faaa5f8-9d91-4177-bc1d-069b935a3e82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.872337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6faaa5f8-9d91-4177-bc1d-069b935a3e82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.909505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6faaa5f8-9d91-4177-bc1d-069b935a3e82 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054025 Aug 29 22:50:49.909915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 534/1076] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:50.147875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f2dd09ab-308e-4489-adf9-1e1905d6e9ea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:50.150045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f2dd09ab-308e-4489-adf9-1e1905d6e9ea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:50.163103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2dd09ab-308e-4489-adf9-1e1905d6e9ea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.165332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2dd09ab-308e-4489-adf9-1e1905d6e9ea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.167603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2dd09ab-308e-4489-adf9-1e1905d6e9ea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.168382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2dd09ab-308e-4489-adf9-1e1905d6e9ea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.168854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2dd09ab-308e-4489-adf9-1e1905d6e9ea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.169306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2dd09ab-308e-4489-adf9-1e1905d6e9ea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.201558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f2dd09ab-308e-4489-adf9-1e1905d6e9ea tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058236 Aug 29 22:50:50.202132 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 543/1077] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:50.714180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bbf27460-4b6d-469f-b1f0-28498bc470d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:50.717669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bbf27460-4b6d-469f-b1f0-28498bc470d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:50.728153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbf27460-4b6d-469f-b1f0-28498bc470d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.728963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbf27460-4b6d-469f-b1f0-28498bc470d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.729427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbf27460-4b6d-469f-b1f0-28498bc470d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.730393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbf27460-4b6d-469f-b1f0-28498bc470d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.731397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbf27460-4b6d-469f-b1f0-28498bc470d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.732166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbf27460-4b6d-469f-b1f0-28498bc470d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.792061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bbf27460-4b6d-469f-b1f0-28498bc470d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083282 Aug 29 22:50:50.793191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 535/1078] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:50.834503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:50.835138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:50.842297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.842789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.843231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.843944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.844441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.844873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.915806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:50.924638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c1edf0d8-d40c-4577-8c86-eb4da4d9b25f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094284 Aug 29 22:50:50.926597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-de43d609-b1c2-4f8e-a946-5c9b8cbc47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:50.927832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 544/1079] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:50 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:50.929458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-de43d609-b1c2-4f8e-a946-5c9b8cbc47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:50.944108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de43d609-b1c2-4f8e-a946-5c9b8cbc47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.944825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de43d609-b1c2-4f8e-a946-5c9b8cbc47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.945264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de43d609-b1c2-4f8e-a946-5c9b8cbc47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.946003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de43d609-b1c2-4f8e-a946-5c9b8cbc47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.946451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de43d609-b1c2-4f8e-a946-5c9b8cbc47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.946871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de43d609-b1c2-4f8e-a946-5c9b8cbc47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.985513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-de43d609-b1c2-4f8e-a946-5c9b8cbc47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066790 Aug 29 22:50:50.986009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 536/1080] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:51.215948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c8cc0b49-4f32-4cd9-baaa-ab68e4c70ab5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:51.218307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c8cc0b49-4f32-4cd9-baaa-ab68e4c70ab5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:51.225433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8cc0b49-4f32-4cd9-baaa-ab68e4c70ab5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.226066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8cc0b49-4f32-4cd9-baaa-ab68e4c70ab5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.226615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8cc0b49-4f32-4cd9-baaa-ab68e4c70ab5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.227395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8cc0b49-4f32-4cd9-baaa-ab68e4c70ab5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.227960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8cc0b49-4f32-4cd9-baaa-ab68e4c70ab5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.228571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8cc0b49-4f32-4cd9-baaa-ab68e4c70ab5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.264670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c8cc0b49-4f32-4cd9-baaa-ab68e4c70ab5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052835 Aug 29 22:50:51.265247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 545/1081] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:51.808714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-50c35717-6188-4ab6-a0bc-2351da583965 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:51.810854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-50c35717-6188-4ab6-a0bc-2351da583965 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:51.817192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50c35717-6188-4ab6-a0bc-2351da583965 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.817669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50c35717-6188-4ab6-a0bc-2351da583965 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.819408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50c35717-6188-4ab6-a0bc-2351da583965 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.820108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50c35717-6188-4ab6-a0bc-2351da583965 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.820591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50c35717-6188-4ab6-a0bc-2351da583965 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.821014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50c35717-6188-4ab6-a0bc-2351da583965 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.856246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-50c35717-6188-4ab6-a0bc-2351da583965 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051616 Aug 29 22:50:51.856829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 537/1082] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:51.953443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:51.954659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:51.964479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.964963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.965401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.966108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.966593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.967024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.002097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cb7cdea5-1de8-4eb0-aa53-cd0da1b4b84a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:52.004310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cb7cdea5-1de8-4eb0-aa53-cd0da1b4b84a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:52.012436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb7cdea5-1de8-4eb0-aa53-cd0da1b4b84a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.012929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb7cdea5-1de8-4eb0-aa53-cd0da1b4b84a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.013364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb7cdea5-1de8-4eb0-aa53-cd0da1b4b84a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.014085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb7cdea5-1de8-4eb0-aa53-cd0da1b4b84a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.014539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb7cdea5-1de8-4eb0-aa53-cd0da1b4b84a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.014962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb7cdea5-1de8-4eb0-aa53-cd0da1b4b84a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.034468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:52.043092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9ed36ed4-5a12-45fe-b3d4-62c8c0ede237 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.096462 Aug 29 22:50:52.043972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 546/1083] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:51 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:52.071763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cb7cdea5-1de8-4eb0-aa53-cd0da1b4b84a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073765 Aug 29 22:50:52.072382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 538/1084] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:52.280686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-710adde2-2cc7-4c72-91aa-f0ae80b77b81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:52.282750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-710adde2-2cc7-4c72-91aa-f0ae80b77b81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:52.289301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-710adde2-2cc7-4c72-91aa-f0ae80b77b81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.289786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-710adde2-2cc7-4c72-91aa-f0ae80b77b81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.290225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-710adde2-2cc7-4c72-91aa-f0ae80b77b81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.290927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-710adde2-2cc7-4c72-91aa-f0ae80b77b81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.291382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-710adde2-2cc7-4c72-91aa-f0ae80b77b81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.291837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-710adde2-2cc7-4c72-91aa-f0ae80b77b81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.329841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-710adde2-2cc7-4c72-91aa-f0ae80b77b81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053485 Aug 29 22:50:52.330497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 547/1085] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:52.870574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1aa86722-9891-480f-9db2-443da03c34e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:52.872750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1aa86722-9891-480f-9db2-443da03c34e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:52.879183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1aa86722-9891-480f-9db2-443da03c34e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.879658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1aa86722-9891-480f-9db2-443da03c34e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.880085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1aa86722-9891-480f-9db2-443da03c34e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.881748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1aa86722-9891-480f-9db2-443da03c34e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.882226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1aa86722-9891-480f-9db2-443da03c34e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.882656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1aa86722-9891-480f-9db2-443da03c34e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.916820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1aa86722-9891-480f-9db2-443da03c34e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050216 Aug 29 22:50:52.917400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 539/1086] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:53.063798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:53.064470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:53.072171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.072659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.073105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.073814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.074279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.074712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.085856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7832b026-6f09-4104-a8e8-c51882ef5539 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:53.088016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7832b026-6f09-4104-a8e8-c51882ef5539 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:53.094117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7832b026-6f09-4104-a8e8-c51882ef5539 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.094617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7832b026-6f09-4104-a8e8-c51882ef5539 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.095028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7832b026-6f09-4104-a8e8-c51882ef5539 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.095720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7832b026-6f09-4104-a8e8-c51882ef5539 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.096195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7832b026-6f09-4104-a8e8-c51882ef5539 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.096618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7832b026-6f09-4104-a8e8-c51882ef5539 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.129063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7832b026-6f09-4104-a8e8-c51882ef5539 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047911 Aug 29 22:50:53.129539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 540/1087] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:53 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:53.152254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:53.161870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6829419b-29d3-4e0a-8769-9c63c3dc6dff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.101881 Aug 29 22:50:53.162597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 548/1088] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:53 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:53.342796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3d2c7d5f-069f-46a3-86ba-110017cf4d63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:53.345025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3d2c7d5f-069f-46a3-86ba-110017cf4d63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:53.353258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d2c7d5f-069f-46a3-86ba-110017cf4d63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.353752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d2c7d5f-069f-46a3-86ba-110017cf4d63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.354188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d2c7d5f-069f-46a3-86ba-110017cf4d63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.354900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d2c7d5f-069f-46a3-86ba-110017cf4d63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.355353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d2c7d5f-069f-46a3-86ba-110017cf4d63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.355804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d2c7d5f-069f-46a3-86ba-110017cf4d63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.388436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3d2c7d5f-069f-46a3-86ba-110017cf4d63 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049357 Aug 29 22:50:53.388918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 541/1089] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:53.929791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5de2b02b-4b51-4fac-acf0-23fbdf53366e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:53.932033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5de2b02b-4b51-4fac-acf0-23fbdf53366e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:53.938147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de2b02b-4b51-4fac-acf0-23fbdf53366e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.938639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de2b02b-4b51-4fac-acf0-23fbdf53366e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.939077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de2b02b-4b51-4fac-acf0-23fbdf53366e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.939788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de2b02b-4b51-4fac-acf0-23fbdf53366e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.940282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de2b02b-4b51-4fac-acf0-23fbdf53366e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.940706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5de2b02b-4b51-4fac-acf0-23fbdf53366e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.974178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5de2b02b-4b51-4fac-acf0-23fbdf53366e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049065 Aug 29 22:50:53.974771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 549/1090] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:54.145234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c717d889-3865-4b9e-b298-5df57025505a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:54.147425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c717d889-3865-4b9e-b298-5df57025505a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:54.154228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c717d889-3865-4b9e-b298-5df57025505a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.154697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c717d889-3865-4b9e-b298-5df57025505a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.155129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c717d889-3865-4b9e-b298-5df57025505a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.155810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c717d889-3865-4b9e-b298-5df57025505a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.156280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c717d889-3865-4b9e-b298-5df57025505a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.156700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c717d889-3865-4b9e-b298-5df57025505a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.189631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c717d889-3865-4b9e-b298-5df57025505a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048320 Aug 29 22:50:54.190197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 542/1091] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:54.193156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:54.194113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:54.200918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.201420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.201866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.202569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.203032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.203459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.286104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:54.295499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5eaea069-0d79-46d7-97c3-57acfd7ab49e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.106701 Aug 29 22:50:54.296078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 550/1092] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:54 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:54.401567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d4d07264-8b62-44ef-9f57-1a5c49c8420b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:54.403765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d4d07264-8b62-44ef-9f57-1a5c49c8420b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:54.409989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d07264-8b62-44ef-9f57-1a5c49c8420b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.410469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d07264-8b62-44ef-9f57-1a5c49c8420b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.410917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d07264-8b62-44ef-9f57-1a5c49c8420b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.412255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d07264-8b62-44ef-9f57-1a5c49c8420b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.412721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d07264-8b62-44ef-9f57-1a5c49c8420b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.413156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d07264-8b62-44ef-9f57-1a5c49c8420b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.451036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d4d07264-8b62-44ef-9f57-1a5c49c8420b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053842 Aug 29 22:50:54.451645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 543/1093] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:54.994579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-78de02fd-2cc7-4c59-b700-cf25d2e71bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:54.998631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-78de02fd-2cc7-4c59-b700-cf25d2e71bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:55.010906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78de02fd-2cc7-4c59-b700-cf25d2e71bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.011857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78de02fd-2cc7-4c59-b700-cf25d2e71bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.012797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78de02fd-2cc7-4c59-b700-cf25d2e71bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.014080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78de02fd-2cc7-4c59-b700-cf25d2e71bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.014968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78de02fd-2cc7-4c59-b700-cf25d2e71bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.015761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78de02fd-2cc7-4c59-b700-cf25d2e71bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.063827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-78de02fd-2cc7-4c59-b700-cf25d2e71bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077284 Aug 29 22:50:55.064484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 551/1094] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:55.202519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7872a90b-a470-435d-a0ed-cdcd9918a495 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:55.204839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7872a90b-a470-435d-a0ed-cdcd9918a495 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:55.212038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7872a90b-a470-435d-a0ed-cdcd9918a495 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.212646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7872a90b-a470-435d-a0ed-cdcd9918a495 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.213126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7872a90b-a470-435d-a0ed-cdcd9918a495 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.213854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7872a90b-a470-435d-a0ed-cdcd9918a495 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.214314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7872a90b-a470-435d-a0ed-cdcd9918a495 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.215048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7872a90b-a470-435d-a0ed-cdcd9918a495 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.251141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7872a90b-a470-435d-a0ed-cdcd9918a495 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052650 Aug 29 22:50:55.251731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 544/1095] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:55.317301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:55.317981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:55.326463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.327216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.327941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.328843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.329404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.329881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.407224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:55.416738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a5aead74-282b-46a7-a1be-3fd00e8ae8b1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.103345 Aug 29 22:50:55.417333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 552/1096] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:55 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:55.466178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cc44ae63-05d6-4153-9b10-b234f35a7660 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:55.468451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cc44ae63-05d6-4153-9b10-b234f35a7660 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:55.475353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc44ae63-05d6-4153-9b10-b234f35a7660 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.475885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc44ae63-05d6-4153-9b10-b234f35a7660 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.476357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc44ae63-05d6-4153-9b10-b234f35a7660 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.477047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc44ae63-05d6-4153-9b10-b234f35a7660 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.477494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc44ae63-05d6-4153-9b10-b234f35a7660 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.477908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc44ae63-05d6-4153-9b10-b234f35a7660 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.508942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cc44ae63-05d6-4153-9b10-b234f35a7660 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047751 Aug 29 22:50:55.509505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 545/1097] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:56.077484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ec8da5ef-9354-4a12-bf3b-2b5436a20b0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:56.079652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ec8da5ef-9354-4a12-bf3b-2b5436a20b0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:56.086288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec8da5ef-9354-4a12-bf3b-2b5436a20b0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.086774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec8da5ef-9354-4a12-bf3b-2b5436a20b0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.087217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec8da5ef-9354-4a12-bf3b-2b5436a20b0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.087966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec8da5ef-9354-4a12-bf3b-2b5436a20b0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.088479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec8da5ef-9354-4a12-bf3b-2b5436a20b0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.088905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec8da5ef-9354-4a12-bf3b-2b5436a20b0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.125002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ec8da5ef-9354-4a12-bf3b-2b5436a20b0c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051642 Aug 29 22:50:56.125709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 553/1098] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:56.264514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b4a7b330-552f-450a-8688-077bf6392032 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:56.266789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b4a7b330-552f-450a-8688-077bf6392032 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:56.274147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4a7b330-552f-450a-8688-077bf6392032 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.274637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4a7b330-552f-450a-8688-077bf6392032 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.275074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4a7b330-552f-450a-8688-077bf6392032 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.275825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4a7b330-552f-450a-8688-077bf6392032 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.276322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4a7b330-552f-450a-8688-077bf6392032 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.276744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4a7b330-552f-450a-8688-077bf6392032 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.308350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b4a7b330-552f-450a-8688-077bf6392032 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047730 Aug 29 22:50:56.308914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 546/1099] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:56.439824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:56.440458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:56.457218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.457706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.458262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.459041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.459669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.460044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.475979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:56.521323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6b0cceb0-0547-49c3-bd2b-b57bcfed2aaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:56.523492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6b0cceb0-0547-49c3-bd2b-b57bcfed2aaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:56.529824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b0cceb0-0547-49c3-bd2b-b57bcfed2aaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.530312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b0cceb0-0547-49c3-bd2b-b57bcfed2aaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.531085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b0cceb0-0547-49c3-bd2b-b57bcfed2aaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.531418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b0cceb0-0547-49c3-bd2b-b57bcfed2aaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.531863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b0cceb0-0547-49c3-bd2b-b57bcfed2aaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.532449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b0cceb0-0547-49c3-bd2b-b57bcfed2aaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.565199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6b0cceb0-0547-49c3-bd2b-b57bcfed2aaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047727 Aug 29 22:50:56.565780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 547/1100] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:56.578511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:56.587433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f8c8b126-0395-4365-b2df-5e41f9ca9d82 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.152666 Aug 29 22:50:56.588012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 554/1101] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:56 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:57.139384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b7696d52-0eec-4298-ad97-26ec61f08a49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:57.141645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b7696d52-0eec-4298-ad97-26ec61f08a49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:57.149750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7696d52-0eec-4298-ad97-26ec61f08a49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.150273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7696d52-0eec-4298-ad97-26ec61f08a49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.150716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7696d52-0eec-4298-ad97-26ec61f08a49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.151423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7696d52-0eec-4298-ad97-26ec61f08a49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.151877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7696d52-0eec-4298-ad97-26ec61f08a49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.152348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7696d52-0eec-4298-ad97-26ec61f08a49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.184715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b7696d52-0eec-4298-ad97-26ec61f08a49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049254 Aug 29 22:50:57.185209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 548/1102] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:57.323359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8577de50-0872-4d1c-828a-3da2340a76bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:57.325564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8577de50-0872-4d1c-828a-3da2340a76bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:57.332178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8577de50-0872-4d1c-828a-3da2340a76bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.332741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8577de50-0872-4d1c-828a-3da2340a76bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.333216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8577de50-0872-4d1c-828a-3da2340a76bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.334638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8577de50-0872-4d1c-828a-3da2340a76bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.335143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8577de50-0872-4d1c-828a-3da2340a76bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.335736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8577de50-0872-4d1c-828a-3da2340a76bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.375463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8577de50-0872-4d1c-828a-3da2340a76bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057933 Aug 29 22:50:57.376432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 555/1103] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:57.578027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-097e8e79-d4c7-4d0c-8eef-2803da4d647e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:57.580110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-097e8e79-d4c7-4d0c-8eef-2803da4d647e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:57.587257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-097e8e79-d4c7-4d0c-8eef-2803da4d647e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.587753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-097e8e79-d4c7-4d0c-8eef-2803da4d647e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.588209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-097e8e79-d4c7-4d0c-8eef-2803da4d647e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.589111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-097e8e79-d4c7-4d0c-8eef-2803da4d647e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.589667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-097e8e79-d4c7-4d0c-8eef-2803da4d647e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.590100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-097e8e79-d4c7-4d0c-8eef-2803da4d647e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.594077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:57.607868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:57.609778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:57.616261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.616847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.617276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.617986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.618434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.618855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.624197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-097e8e79-d4c7-4d0c-8eef-2803da4d647e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050166 Aug 29 22:50:57.624805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 549/1104] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:57.688655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:57.698188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-59933b1f-4e74-4525-9aa5-2c8dce44793e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094063 Aug 29 22:50:57.698798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 556/1105] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:57 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:58.198197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fdae6138-4e18-4c85-830c-859807bb6ded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:58.200339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fdae6138-4e18-4c85-830c-859807bb6ded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:58.206932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdae6138-4e18-4c85-830c-859807bb6ded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.207418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdae6138-4e18-4c85-830c-859807bb6ded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.207853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdae6138-4e18-4c85-830c-859807bb6ded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.209083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdae6138-4e18-4c85-830c-859807bb6ded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.209660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdae6138-4e18-4c85-830c-859807bb6ded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.210092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdae6138-4e18-4c85-830c-859807bb6ded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.242703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fdae6138-4e18-4c85-830c-859807bb6ded tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048996 Aug 29 22:50:58.243276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 550/1106] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:50:58.390537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-efb7d6f7-6c65-4dab-8ef6-5ba7bae5829e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:58.393725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-efb7d6f7-6c65-4dab-8ef6-5ba7bae5829e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:58.403192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-efb7d6f7-6c65-4dab-8ef6-5ba7bae5829e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.403682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-efb7d6f7-6c65-4dab-8ef6-5ba7bae5829e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.404119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-efb7d6f7-6c65-4dab-8ef6-5ba7bae5829e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.404874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-efb7d6f7-6c65-4dab-8ef6-5ba7bae5829e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.405326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-efb7d6f7-6c65-4dab-8ef6-5ba7bae5829e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.405756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-efb7d6f7-6c65-4dab-8ef6-5ba7bae5829e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.438056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-efb7d6f7-6c65-4dab-8ef6-5ba7bae5829e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052914 Aug 29 22:50:58.438615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 557/1107] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:58.641852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6cf6b941-495b-42ef-8429-4b38b7c73ccf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:58.643994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6cf6b941-495b-42ef-8429-4b38b7c73ccf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:58.654430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf6b941-495b-42ef-8429-4b38b7c73ccf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.655287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf6b941-495b-42ef-8429-4b38b7c73ccf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.656074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf6b941-495b-42ef-8429-4b38b7c73ccf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.657332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf6b941-495b-42ef-8429-4b38b7c73ccf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.658158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf6b941-495b-42ef-8429-4b38b7c73ccf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.658920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf6b941-495b-42ef-8429-4b38b7c73ccf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.691158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6cf6b941-495b-42ef-8429-4b38b7c73ccf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053443 Aug 29 22:50:58.691724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 551/1108] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:58.720609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:58.721854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:58.729156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.729638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.730075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.730777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.731258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.731719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.824468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:58.833005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e5231a3f-348e-475e-8420-5bc325a075b8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.117449 Aug 29 22:50:58.834215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 558/1109] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:58 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:59.255738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2b3ed210-5b2e-449b-bed4-e6daf78a0bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:59.258012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2b3ed210-5b2e-449b-bed4-e6daf78a0bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:59.263973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b3ed210-5b2e-449b-bed4-e6daf78a0bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.264470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b3ed210-5b2e-449b-bed4-e6daf78a0bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.264899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b3ed210-5b2e-449b-bed4-e6daf78a0bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.265581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b3ed210-5b2e-449b-bed4-e6daf78a0bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.266020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b3ed210-5b2e-449b-bed4-e6daf78a0bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.266431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b3ed210-5b2e-449b-bed4-e6daf78a0bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.297986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2b3ed210-5b2e-449b-bed4-e6daf78a0bd2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046628 Aug 29 22:50:59.298540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 552/1110] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:50:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:59.450596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ddd91bf1-08d0-46e2-a4ff-0381bc825e84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:59.452791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ddd91bf1-08d0-46e2-a4ff-0381bc825e84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:59.461288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddd91bf1-08d0-46e2-a4ff-0381bc825e84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.463572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddd91bf1-08d0-46e2-a4ff-0381bc825e84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.463572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddd91bf1-08d0-46e2-a4ff-0381bc825e84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.463572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddd91bf1-08d0-46e2-a4ff-0381bc825e84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.463572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddd91bf1-08d0-46e2-a4ff-0381bc825e84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.464185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ddd91bf1-08d0-46e2-a4ff-0381bc825e84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.497751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ddd91bf1-08d0-46e2-a4ff-0381bc825e84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051103 Aug 29 22:50:59.498858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 559/1111] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:59.705292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-70d14488-1c7f-4180-855a-c50cadfaca48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:59.707778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-70d14488-1c7f-4180-855a-c50cadfaca48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:59.715010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d14488-1c7f-4180-855a-c50cadfaca48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.715483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d14488-1c7f-4180-855a-c50cadfaca48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.715911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d14488-1c7f-4180-855a-c50cadfaca48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.716698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d14488-1c7f-4180-855a-c50cadfaca48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.717147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d14488-1c7f-4180-855a-c50cadfaca48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.717557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d14488-1c7f-4180-855a-c50cadfaca48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.750961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-70d14488-1c7f-4180-855a-c50cadfaca48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050162 Aug 29 22:50:59.751542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 553/1112] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:50:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:59.855046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:59.855663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:59.862309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.862799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.863236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.863935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.864422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.864943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.929673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:59.937624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0914c7b0-9112-4cce-8be3-129fd0904dc0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086427 Aug 29 22:50:59.938402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 560/1113] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:59 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:00.311069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1e447db2-c459-462c-8cd5-213a3cf27b9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:00.313295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1e447db2-c459-462c-8cd5-213a3cf27b9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:00.319948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e447db2-c459-462c-8cd5-213a3cf27b9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.320449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e447db2-c459-462c-8cd5-213a3cf27b9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.320876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e447db2-c459-462c-8cd5-213a3cf27b9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.321575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e447db2-c459-462c-8cd5-213a3cf27b9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.322015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e447db2-c459-462c-8cd5-213a3cf27b9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.322427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e447db2-c459-462c-8cd5-213a3cf27b9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.353273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1e447db2-c459-462c-8cd5-213a3cf27b9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046223 Aug 29 22:51:00.353842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 554/1114] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:00.511271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-328700ab-5c89-4a4c-a2b6-1673b3fb23cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:00.513606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-328700ab-5c89-4a4c-a2b6-1673b3fb23cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:00.519644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-328700ab-5c89-4a4c-a2b6-1673b3fb23cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.520127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-328700ab-5c89-4a4c-a2b6-1673b3fb23cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.520599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-328700ab-5c89-4a4c-a2b6-1673b3fb23cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.521801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-328700ab-5c89-4a4c-a2b6-1673b3fb23cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.522371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-328700ab-5c89-4a4c-a2b6-1673b3fb23cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.522802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-328700ab-5c89-4a4c-a2b6-1673b3fb23cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.553131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-328700ab-5c89-4a4c-a2b6-1673b3fb23cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Aug 29 22:51:00.553699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 561/1115] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:00.763417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a67efcd0-0c0b-4d65-a9c3-428cff158cfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:00.765602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a67efcd0-0c0b-4d65-a9c3-428cff158cfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:00.773097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a67efcd0-0c0b-4d65-a9c3-428cff158cfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.773585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a67efcd0-0c0b-4d65-a9c3-428cff158cfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.774140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a67efcd0-0c0b-4d65-a9c3-428cff158cfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.774728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a67efcd0-0c0b-4d65-a9c3-428cff158cfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.776004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a67efcd0-0c0b-4d65-a9c3-428cff158cfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.776004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a67efcd0-0c0b-4d65-a9c3-428cff158cfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.809045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a67efcd0-0c0b-4d65-a9c3-428cff158cfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049547 Aug 29 22:51:00.809622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 555/1116] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:00.961563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:00.962172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:00.968633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.969111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.969549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.970241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.970702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.971128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.034668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:01.043091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-314716ed-5cb8-4c95-8202-168d2f039dcb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086090 Aug 29 22:51:01.043654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 562/1117] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:00 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:01.366103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-12b54617-9e62-4935-9ede-a3bdd3686a4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:01.368161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-12b54617-9e62-4935-9ede-a3bdd3686a4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:01.374161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12b54617-9e62-4935-9ede-a3bdd3686a4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.374631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12b54617-9e62-4935-9ede-a3bdd3686a4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.375060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12b54617-9e62-4935-9ede-a3bdd3686a4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.375749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12b54617-9e62-4935-9ede-a3bdd3686a4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.376211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12b54617-9e62-4935-9ede-a3bdd3686a4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.376626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12b54617-9e62-4935-9ede-a3bdd3686a4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.417204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-12b54617-9e62-4935-9ede-a3bdd3686a4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055577 Aug 29 22:51:01.417794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 556/1118] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:01.565979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1327e646-150b-4c92-80de-317553036192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:01.568794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1327e646-150b-4c92-80de-317553036192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:01.574690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1327e646-150b-4c92-80de-317553036192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.575176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1327e646-150b-4c92-80de-317553036192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.575606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1327e646-150b-4c92-80de-317553036192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.576342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1327e646-150b-4c92-80de-317553036192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.576796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1327e646-150b-4c92-80de-317553036192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.577218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1327e646-150b-4c92-80de-317553036192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.608827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1327e646-150b-4c92-80de-317553036192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046773 Aug 29 22:51:01.609404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 563/1119] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:01.822510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ee64feaa-ae50-4853-8083-a9bcb8ff55d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:01.824744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ee64feaa-ae50-4853-8083-a9bcb8ff55d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:01.831804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee64feaa-ae50-4853-8083-a9bcb8ff55d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.832312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee64feaa-ae50-4853-8083-a9bcb8ff55d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.832744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee64feaa-ae50-4853-8083-a9bcb8ff55d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.833546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee64feaa-ae50-4853-8083-a9bcb8ff55d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.834061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee64feaa-ae50-4853-8083-a9bcb8ff55d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.834484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee64feaa-ae50-4853-8083-a9bcb8ff55d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.868312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ee64feaa-ae50-4853-8083-a9bcb8ff55d6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050300 Aug 29 22:51:01.868928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 557/1120] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:02.064524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:02.065245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:02.072734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.073213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.073645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.074344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.074795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.075218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.141992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:02.151357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5be4f9e7-d9a1-45f3-a210-8cf57c16b1c5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090788 Aug 29 22:51:02.151953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 564/1121] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:02 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:02.431777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d623b2df-c999-4b60-baa1-1e803d60210c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:02.433998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d623b2df-c999-4b60-baa1-1e803d60210c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:02.440993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d623b2df-c999-4b60-baa1-1e803d60210c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.440993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d623b2df-c999-4b60-baa1-1e803d60210c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.441871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d623b2df-c999-4b60-baa1-1e803d60210c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.442090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d623b2df-c999-4b60-baa1-1e803d60210c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.442587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d623b2df-c999-4b60-baa1-1e803d60210c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.443140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d623b2df-c999-4b60-baa1-1e803d60210c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.476089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d623b2df-c999-4b60-baa1-1e803d60210c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049589 Aug 29 22:51:02.476736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 558/1122] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:02.621587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ca9d4bf3-d346-41ac-9b98-15711a500ecf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:02.623793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ca9d4bf3-d346-41ac-9b98-15711a500ecf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:02.630380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9d4bf3-d346-41ac-9b98-15711a500ecf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.630863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9d4bf3-d346-41ac-9b98-15711a500ecf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.631397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9d4bf3-d346-41ac-9b98-15711a500ecf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.632106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9d4bf3-d346-41ac-9b98-15711a500ecf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.632597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9d4bf3-d346-41ac-9b98-15711a500ecf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.633025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9d4bf3-d346-41ac-9b98-15711a500ecf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.665247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ca9d4bf3-d346-41ac-9b98-15711a500ecf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047544 Aug 29 22:51:02.665824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 565/1123] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:02.881762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-56ddc7b0-8e64-42e7-bcc7-76d1c2ab0a3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:02.884657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-56ddc7b0-8e64-42e7-bcc7-76d1c2ab0a3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:02.891179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b0-8e64-42e7-bcc7-76d1c2ab0a3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.891661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b0-8e64-42e7-bcc7-76d1c2ab0a3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.892083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b0-8e64-42e7-bcc7-76d1c2ab0a3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.892807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b0-8e64-42e7-bcc7-76d1c2ab0a3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.893249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b0-8e64-42e7-bcc7-76d1c2ab0a3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.893670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56ddc7b0-8e64-42e7-bcc7-76d1c2ab0a3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.926612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-56ddc7b0-8e64-42e7-bcc7-76d1c2ab0a3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048990 Aug 29 22:51:02.926757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 559/1124] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:03.173191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:03.173722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:03.181951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.182620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.183169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.184303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.185022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.185556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.254811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:03.263476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2042473e-956f-4a7d-9fac-e9d3aa161c4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094284 Aug 29 22:51:03.264060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 566/1125] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:03 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:03.488807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a5d55de9-f876-4b2f-a389-b643184c7d4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:03.490982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a5d55de9-f876-4b2f-a389-b643184c7d4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:03.497208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5d55de9-f876-4b2f-a389-b643184c7d4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.497688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5d55de9-f876-4b2f-a389-b643184c7d4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.498116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5d55de9-f876-4b2f-a389-b643184c7d4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.498807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5d55de9-f876-4b2f-a389-b643184c7d4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.499246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5d55de9-f876-4b2f-a389-b643184c7d4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.499663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5d55de9-f876-4b2f-a389-b643184c7d4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.531363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a5d55de9-f876-4b2f-a389-b643184c7d4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046568 Aug 29 22:51:03.531935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 560/1126] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:03.677865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-36d18ac9-6e8e-446e-bab1-2be867a5f83a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:03.680101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-36d18ac9-6e8e-446e-bab1-2be867a5f83a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:03.688216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36d18ac9-6e8e-446e-bab1-2be867a5f83a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.688707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36d18ac9-6e8e-446e-bab1-2be867a5f83a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.689142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36d18ac9-6e8e-446e-bab1-2be867a5f83a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.689846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36d18ac9-6e8e-446e-bab1-2be867a5f83a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.690298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36d18ac9-6e8e-446e-bab1-2be867a5f83a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.690721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36d18ac9-6e8e-446e-bab1-2be867a5f83a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.722360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-36d18ac9-6e8e-446e-bab1-2be867a5f83a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048427 Aug 29 22:51:03.728683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 567/1127] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:03.939120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e58edb72-34b5-4df1-86cd-771336fbd182 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:03.941316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e58edb72-34b5-4df1-86cd-771336fbd182 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:03.948727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e58edb72-34b5-4df1-86cd-771336fbd182 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.949207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e58edb72-34b5-4df1-86cd-771336fbd182 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.949634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e58edb72-34b5-4df1-86cd-771336fbd182 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.950325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e58edb72-34b5-4df1-86cd-771336fbd182 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.950773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e58edb72-34b5-4df1-86cd-771336fbd182 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.951190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e58edb72-34b5-4df1-86cd-771336fbd182 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.982073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e58edb72-34b5-4df1-86cd-771336fbd182 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046866 Aug 29 22:51:03.982754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 561/1128] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:04.284889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:04.285484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:04.292223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.292714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.293162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.293870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.294331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.294757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.357207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:04.365870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d428aea3-5a31-435a-b84f-9ae51bf48b7b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084793 Aug 29 22:51:04.366456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 568/1129] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:04 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:04.548109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b18ced4c-dc1e-4f93-9916-16771175881b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:04.550198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b18ced4c-dc1e-4f93-9916-16771175881b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:04.556268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b18ced4c-dc1e-4f93-9916-16771175881b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.556742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b18ced4c-dc1e-4f93-9916-16771175881b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.557168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b18ced4c-dc1e-4f93-9916-16771175881b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.557855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b18ced4c-dc1e-4f93-9916-16771175881b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.558297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b18ced4c-dc1e-4f93-9916-16771175881b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.558712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b18ced4c-dc1e-4f93-9916-16771175881b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.590124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b18ced4c-dc1e-4f93-9916-16771175881b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046089 Aug 29 22:51:04.590691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 562/1130] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:04.736587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-adfbb6e4-cfe5-4e2e-8074-7c53fac26e68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:04.738729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-adfbb6e4-cfe5-4e2e-8074-7c53fac26e68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:04.745924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adfbb6e4-cfe5-4e2e-8074-7c53fac26e68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.746548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adfbb6e4-cfe5-4e2e-8074-7c53fac26e68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.747069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adfbb6e4-cfe5-4e2e-8074-7c53fac26e68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.747875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adfbb6e4-cfe5-4e2e-8074-7c53fac26e68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.748492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adfbb6e4-cfe5-4e2e-8074-7c53fac26e68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.749011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adfbb6e4-cfe5-4e2e-8074-7c53fac26e68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.786210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-adfbb6e4-cfe5-4e2e-8074-7c53fac26e68 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053514 Aug 29 22:51:04.786935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 569/1131] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:04.995224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-19883c1b-b73a-4069-9a7a-690a674242b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:04.997411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-19883c1b-b73a-4069-9a7a-690a674242b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:05.003811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-19883c1b-b73a-4069-9a7a-690a674242b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.005817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-19883c1b-b73a-4069-9a7a-690a674242b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.007109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-19883c1b-b73a-4069-9a7a-690a674242b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.007808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-19883c1b-b73a-4069-9a7a-690a674242b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.008291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-19883c1b-b73a-4069-9a7a-690a674242b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.008719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-19883c1b-b73a-4069-9a7a-690a674242b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.038598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-19883c1b-b73a-4069-9a7a-690a674242b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Aug 29 22:51:05.039162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 563/1132] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:05.386577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:05.387213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:05.394377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.394882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.395318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.396054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.396607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.397228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.460867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:05.468751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1932981f-aa6f-44b8-a0e1-b3e9cdf6a2ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086111 Aug 29 22:51:05.469322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 570/1133] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:05 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:05.603603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9f5d106c-dc29-4aa0-abcc-03dac248c55f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:05.605810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9f5d106c-dc29-4aa0-abcc-03dac248c55f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:05.611909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f5d106c-dc29-4aa0-abcc-03dac248c55f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.612450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f5d106c-dc29-4aa0-abcc-03dac248c55f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.612883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f5d106c-dc29-4aa0-abcc-03dac248c55f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.613581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f5d106c-dc29-4aa0-abcc-03dac248c55f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.614055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f5d106c-dc29-4aa0-abcc-03dac248c55f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.615142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f5d106c-dc29-4aa0-abcc-03dac248c55f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.645343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9f5d106c-dc29-4aa0-abcc-03dac248c55f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046672 Aug 29 22:51:05.646070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 564/1134] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:05.798941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1625f784-4fc0-4ae5-b757-569e698ce042 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:05.801165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1625f784-4fc0-4ae5-b757-569e698ce042 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:05.807736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1625f784-4fc0-4ae5-b757-569e698ce042 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.808296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1625f784-4fc0-4ae5-b757-569e698ce042 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.808740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1625f784-4fc0-4ae5-b757-569e698ce042 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.809450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1625f784-4fc0-4ae5-b757-569e698ce042 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.809904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1625f784-4fc0-4ae5-b757-569e698ce042 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.810342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1625f784-4fc0-4ae5-b757-569e698ce042 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.813108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:05.842828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1625f784-4fc0-4ae5-b757-569e698ce042 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047606 Aug 29 22:51:05.843302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 571/1135] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:05 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:06.051192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a54e6f18-74ce-43ab-9af2-d692c39b420a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:06.053329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a54e6f18-74ce-43ab-9af2-d692c39b420a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:06.055687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:06.060434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a54e6f18-74ce-43ab-9af2-d692c39b420a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.060917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a54e6f18-74ce-43ab-9af2-d692c39b420a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.061350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a54e6f18-74ce-43ab-9af2-d692c39b420a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.062051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a54e6f18-74ce-43ab-9af2-d692c39b420a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.062504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a54e6f18-74ce-43ab-9af2-d692c39b420a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.062928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a54e6f18-74ce-43ab-9af2-d692c39b420a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.090324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:06.095198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a54e6f18-74ce-43ab-9af2-d692c39b420a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048160 Aug 29 22:51:06.095776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 565/1136] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:06.491306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:06.491922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:06.494778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:06.499971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.500200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.500639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.501380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.501836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.502297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.567095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:06.575751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6ebd0a8f-90db-417e-b03d-9e8f2c2a6618 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089725 Aug 29 22:51:06.576385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 572/1137] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:06 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:06.658607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5f17b78b-eff2-495c-be5e-7df44dc8305f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:06.660831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5f17b78b-eff2-495c-be5e-7df44dc8305f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:06.668285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f17b78b-eff2-495c-be5e-7df44dc8305f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.668771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f17b78b-eff2-495c-be5e-7df44dc8305f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.669204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f17b78b-eff2-495c-be5e-7df44dc8305f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.669917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f17b78b-eff2-495c-be5e-7df44dc8305f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.670368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f17b78b-eff2-495c-be5e-7df44dc8305f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.670793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f17b78b-eff2-495c-be5e-7df44dc8305f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.701141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5f17b78b-eff2-495c-be5e-7df44dc8305f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046600 Aug 29 22:51:06.701705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 566/1138] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:06.855721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-068e4fe8-f69c-4158-9ff4-600c030c755a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:06.857931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-068e4fe8-f69c-4158-9ff4-600c030c755a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:06.864549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-068e4fe8-f69c-4158-9ff4-600c030c755a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.865322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-068e4fe8-f69c-4158-9ff4-600c030c755a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.866321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-068e4fe8-f69c-4158-9ff4-600c030c755a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.866488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-068e4fe8-f69c-4158-9ff4-600c030c755a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.866893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-068e4fe8-f69c-4158-9ff4-600c030c755a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.867323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-068e4fe8-f69c-4158-9ff4-600c030c755a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.900198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-068e4fe8-f69c-4158-9ff4-600c030c755a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048449 Aug 29 22:51:06.900782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 573/1139] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:07.111852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5ad9e05d-4af2-4486-8add-557e75922f37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:07.114012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5ad9e05d-4af2-4486-8add-557e75922f37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:07.120755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ad9e05d-4af2-4486-8add-557e75922f37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.121246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ad9e05d-4af2-4486-8add-557e75922f37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.121795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ad9e05d-4af2-4486-8add-557e75922f37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.122459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ad9e05d-4af2-4486-8add-557e75922f37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.122910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ad9e05d-4af2-4486-8add-557e75922f37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.123335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ad9e05d-4af2-4486-8add-557e75922f37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.155460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5ad9e05d-4af2-4486-8add-557e75922f37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047668 Aug 29 22:51:07.156055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 567/1140] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:07.599347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:07.600447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:07.607382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.607880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.608359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.609060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.609514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.609951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.676705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:07.685257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c88e6d3b-a87c-4af5-bebc-e7766d9ee1d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090399 Aug 29 22:51:07.685828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 574/1141] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:07 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:07.713902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9628dc3c-985d-402e-8dc3-f2387cfd79b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:07.715951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9628dc3c-985d-402e-8dc3-f2387cfd79b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:07.721906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9628dc3c-985d-402e-8dc3-f2387cfd79b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.722379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9628dc3c-985d-402e-8dc3-f2387cfd79b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.722828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9628dc3c-985d-402e-8dc3-f2387cfd79b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.723495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9628dc3c-985d-402e-8dc3-f2387cfd79b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.724645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9628dc3c-985d-402e-8dc3-f2387cfd79b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.725056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9628dc3c-985d-402e-8dc3-f2387cfd79b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.756583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9628dc3c-985d-402e-8dc3-f2387cfd79b9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046432 Aug 29 22:51:07.757163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 568/1142] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:07.914552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e4b67d78-d092-48d5-8e8d-8c118e9b837c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:07.916856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e4b67d78-d092-48d5-8e8d-8c118e9b837c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:07.923190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4b67d78-d092-48d5-8e8d-8c118e9b837c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.923675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4b67d78-d092-48d5-8e8d-8c118e9b837c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.924105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4b67d78-d092-48d5-8e8d-8c118e9b837c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.924839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4b67d78-d092-48d5-8e8d-8c118e9b837c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.925286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4b67d78-d092-48d5-8e8d-8c118e9b837c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.925717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4b67d78-d092-48d5-8e8d-8c118e9b837c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.960400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e4b67d78-d092-48d5-8e8d-8c118e9b837c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051514 Aug 29 22:51:07.960987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 575/1143] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:08.169042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dadc7459-963b-4b3d-8e91-3eb8829fd8be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:08.171342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dadc7459-963b-4b3d-8e91-3eb8829fd8be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:08.178478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dadc7459-963b-4b3d-8e91-3eb8829fd8be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.178963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dadc7459-963b-4b3d-8e91-3eb8829fd8be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.179397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dadc7459-963b-4b3d-8e91-3eb8829fd8be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.180112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dadc7459-963b-4b3d-8e91-3eb8829fd8be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.180587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dadc7459-963b-4b3d-8e91-3eb8829fd8be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.181008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dadc7459-963b-4b3d-8e91-3eb8829fd8be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.213902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dadc7459-963b-4b3d-8e91-3eb8829fd8be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048924 Aug 29 22:51:08.214478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 569/1144] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:08.709452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:08.710071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:08.717101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.717426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.717871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.718592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.719040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.719597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.769138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3c7ab970-f163-46b1-8e95-5f0896b38250 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:08.771465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3c7ab970-f163-46b1-8e95-5f0896b38250 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:08.778025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c7ab970-f163-46b1-8e95-5f0896b38250 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.778750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c7ab970-f163-46b1-8e95-5f0896b38250 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.779275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c7ab970-f163-46b1-8e95-5f0896b38250 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.780124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c7ab970-f163-46b1-8e95-5f0896b38250 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.780763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c7ab970-f163-46b1-8e95-5f0896b38250 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.781282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c7ab970-f163-46b1-8e95-5f0896b38250 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.791222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:08.799276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6159d8b7-394e-4a41-bc9d-3fa3378db4a9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.096234 Aug 29 22:51:08.799865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 576/1145] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:08 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:08.825494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3c7ab970-f163-46b1-8e95-5f0896b38250 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060248 Aug 29 22:51:08.826073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 570/1146] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:08.973375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d682d5c3-955e-426a-9b1d-49f3f0954f23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:08.975483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d682d5c3-955e-426a-9b1d-49f3f0954f23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:08.981600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d682d5c3-955e-426a-9b1d-49f3f0954f23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.982077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d682d5c3-955e-426a-9b1d-49f3f0954f23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.982507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d682d5c3-955e-426a-9b1d-49f3f0954f23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.983246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d682d5c3-955e-426a-9b1d-49f3f0954f23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.983696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d682d5c3-955e-426a-9b1d-49f3f0954f23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.984117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d682d5c3-955e-426a-9b1d-49f3f0954f23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.017372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d682d5c3-955e-426a-9b1d-49f3f0954f23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048133 Aug 29 22:51:09.017941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 577/1147] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:09.227130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c7a10b3d-34b6-4fa7-ad18-a2412dd9e6f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:09.229208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c7a10b3d-34b6-4fa7-ad18-a2412dd9e6f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:09.235644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7a10b3d-34b6-4fa7-ad18-a2412dd9e6f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.236120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7a10b3d-34b6-4fa7-ad18-a2412dd9e6f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.236585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7a10b3d-34b6-4fa7-ad18-a2412dd9e6f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.237275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7a10b3d-34b6-4fa7-ad18-a2412dd9e6f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.237721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7a10b3d-34b6-4fa7-ad18-a2412dd9e6f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.238136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7a10b3d-34b6-4fa7-ad18-a2412dd9e6f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.268878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c7a10b3d-34b6-4fa7-ad18-a2412dd9e6f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046078 Aug 29 22:51:09.269441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 571/1148] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:09.821545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:09.822217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:09.828809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.829311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.829739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.830669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.831119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.831535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.841787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2b5e539f-7787-4a15-987c-31d8358f7149 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:09.844087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2b5e539f-7787-4a15-987c-31d8358f7149 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:09.850633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b5e539f-7787-4a15-987c-31d8358f7149 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.851197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b5e539f-7787-4a15-987c-31d8358f7149 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.851636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b5e539f-7787-4a15-987c-31d8358f7149 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.852417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b5e539f-7787-4a15-987c-31d8358f7149 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.852876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b5e539f-7787-4a15-987c-31d8358f7149 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.853296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b5e539f-7787-4a15-987c-31d8358f7149 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.887176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2b5e539f-7787-4a15-987c-31d8358f7149 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049204 Aug 29 22:51:09.887664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 572/1149] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:09.900423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:09.908411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-949cd749-9f1d-4aee-85a7-25d7dd10dacd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091087 Aug 29 22:51:09.909701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 578/1150] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:09 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:10.029780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7dbfd399-7c59-401f-9524-dd407d8080f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:10.031934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7dbfd399-7c59-401f-9524-dd407d8080f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:10.038107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7dbfd399-7c59-401f-9524-dd407d8080f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.038596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7dbfd399-7c59-401f-9524-dd407d8080f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.039034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7dbfd399-7c59-401f-9524-dd407d8080f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.039742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7dbfd399-7c59-401f-9524-dd407d8080f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.040219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7dbfd399-7c59-401f-9524-dd407d8080f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.040653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7dbfd399-7c59-401f-9524-dd407d8080f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.073559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7dbfd399-7c59-401f-9524-dd407d8080f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047722 Aug 29 22:51:10.074260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 573/1151] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:10.282298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a6819ce5-9d7b-4355-b966-5f6c05cad1ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:10.284388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a6819ce5-9d7b-4355-b966-5f6c05cad1ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:10.290546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6819ce5-9d7b-4355-b966-5f6c05cad1ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.291025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6819ce5-9d7b-4355-b966-5f6c05cad1ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.291456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6819ce5-9d7b-4355-b966-5f6c05cad1ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.292186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6819ce5-9d7b-4355-b966-5f6c05cad1ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.292616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6819ce5-9d7b-4355-b966-5f6c05cad1ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.293033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6819ce5-9d7b-4355-b966-5f6c05cad1ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.323296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a6819ce5-9d7b-4355-b966-5f6c05cad1ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Aug 29 22:51:10.323845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 579/1152] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:10.902886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5e9a3966-e28c-4671-8fe2-8254967a9a9d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:10.905176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5e9a3966-e28c-4671-8fe2-8254967a9a9d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:10.912679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e9a3966-e28c-4671-8fe2-8254967a9a9d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.913141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e9a3966-e28c-4671-8fe2-8254967a9a9d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.913682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e9a3966-e28c-4671-8fe2-8254967a9a9d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.914313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e9a3966-e28c-4671-8fe2-8254967a9a9d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.914764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e9a3966-e28c-4671-8fe2-8254967a9a9d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.915181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e9a3966-e28c-4671-8fe2-8254967a9a9d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.932589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:10.933259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:10.939934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.940471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.940908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.941615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.942079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.943078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.951204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5e9a3966-e28c-4671-8fe2-8254967a9a9d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052631 Aug 29 22:51:10.951779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 574/1153] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:11.009513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:11.017720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-004e0b5c-b52e-4a5c-a0c2-4aced08b8245 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090620 Aug 29 22:51:11.018307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 580/1154] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:10 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:11.087023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c399c79f-33b4-4232-93b9-ed52d66c27e4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:11.089252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c399c79f-33b4-4232-93b9-ed52d66c27e4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:11.095475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c399c79f-33b4-4232-93b9-ed52d66c27e4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.095959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c399c79f-33b4-4232-93b9-ed52d66c27e4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.096414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c399c79f-33b4-4232-93b9-ed52d66c27e4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.097110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c399c79f-33b4-4232-93b9-ed52d66c27e4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.097562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c399c79f-33b4-4232-93b9-ed52d66c27e4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.097975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c399c79f-33b4-4232-93b9-ed52d66c27e4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.130782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c399c79f-33b4-4232-93b9-ed52d66c27e4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047365 Aug 29 22:51:11.131537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 575/1155] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:11 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:11.336394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-595e1ba0-17aa-4291-acc2-dad41a7be2e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:11.338736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-595e1ba0-17aa-4291-acc2-dad41a7be2e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:11.345200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-595e1ba0-17aa-4291-acc2-dad41a7be2e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.345689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-595e1ba0-17aa-4291-acc2-dad41a7be2e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.346126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-595e1ba0-17aa-4291-acc2-dad41a7be2e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.346853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-595e1ba0-17aa-4291-acc2-dad41a7be2e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.347308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-595e1ba0-17aa-4291-acc2-dad41a7be2e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.347730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-595e1ba0-17aa-4291-acc2-dad41a7be2e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.383574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-595e1ba0-17aa-4291-acc2-dad41a7be2e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051437 Aug 29 22:51:11.384164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 581/1156] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:11.964636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c6e13ffe-9100-4770-9ee7-14e0b88625c4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:11.967033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c6e13ffe-9100-4770-9ee7-14e0b88625c4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:11.973645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6e13ffe-9100-4770-9ee7-14e0b88625c4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.974126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6e13ffe-9100-4770-9ee7-14e0b88625c4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.974602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6e13ffe-9100-4770-9ee7-14e0b88625c4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.975303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6e13ffe-9100-4770-9ee7-14e0b88625c4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.975748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6e13ffe-9100-4770-9ee7-14e0b88625c4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.976184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6e13ffe-9100-4770-9ee7-14e0b88625c4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.029177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c6e13ffe-9100-4770-9ee7-14e0b88625c4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068639 Aug 29 22:51:12.029660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 576/1157] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:12.040643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:12.041256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:12.047781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:12.048311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:12.048752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.049451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:12.049912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:12.050341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.119151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:12.126917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-237bb85e-9c43-43cc-978d-6f2521b19212 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090969 Aug 29 22:51:12.127479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 582/1158] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:12 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:12.142988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-238a4168-28f0-452a-9d82-d3de43b51ed5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:12.145166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-238a4168-28f0-452a-9d82-d3de43b51ed5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:12.151757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-238a4168-28f0-452a-9d82-d3de43b51ed5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:12.152285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-238a4168-28f0-452a-9d82-d3de43b51ed5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:12.152721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-238a4168-28f0-452a-9d82-d3de43b51ed5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.153423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-238a4168-28f0-452a-9d82-d3de43b51ed5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:12.153874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-238a4168-28f0-452a-9d82-d3de43b51ed5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:12.154292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-238a4168-28f0-452a-9d82-d3de43b51ed5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.186412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-238a4168-28f0-452a-9d82-d3de43b51ed5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047386 Aug 29 22:51:12.186978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 577/1159] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:12.395575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7ab75c40-4c40-40f8-a60e-37fc46b062c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:12.397802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7ab75c40-4c40-40f8-a60e-37fc46b062c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:12.403986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ab75c40-4c40-40f8-a60e-37fc46b062c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:12.404500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ab75c40-4c40-40f8-a60e-37fc46b062c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:12.404928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ab75c40-4c40-40f8-a60e-37fc46b062c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.405625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ab75c40-4c40-40f8-a60e-37fc46b062c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:12.406075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ab75c40-4c40-40f8-a60e-37fc46b062c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:12.406501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ab75c40-4c40-40f8-a60e-37fc46b062c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.448473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7ab75c40-4c40-40f8-a60e-37fc46b062c9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056701 Aug 29 22:51:12.449551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 583/1160] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:13.042363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d7c8b78e-5b4f-4a0c-b486-7e4d1c3b1e0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:13.044456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d7c8b78e-5b4f-4a0c-b486-7e4d1c3b1e0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:13.051110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7c8b78e-5b4f-4a0c-b486-7e4d1c3b1e0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.051600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7c8b78e-5b4f-4a0c-b486-7e4d1c3b1e0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.052057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7c8b78e-5b4f-4a0c-b486-7e4d1c3b1e0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.052802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7c8b78e-5b4f-4a0c-b486-7e4d1c3b1e0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.053257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7c8b78e-5b4f-4a0c-b486-7e4d1c3b1e0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.053680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7c8b78e-5b4f-4a0c-b486-7e4d1c3b1e0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.085941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d7c8b78e-5b4f-4a0c-b486-7e4d1c3b1e0a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047809 Aug 29 22:51:13.086515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 578/1161] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:13.149275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:13.149890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:13.156474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.156959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.157397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.158092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.158554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.158978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.200029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-de3c8f34-0b89-4b28-aee0-cd0e7797e92f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:13.202427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-de3c8f34-0b89-4b28-aee0-cd0e7797e92f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:13.209135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de3c8f34-0b89-4b28-aee0-cd0e7797e92f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.209834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de3c8f34-0b89-4b28-aee0-cd0e7797e92f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.210044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de3c8f34-0b89-4b28-aee0-cd0e7797e92f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.210752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de3c8f34-0b89-4b28-aee0-cd0e7797e92f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.211203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de3c8f34-0b89-4b28-aee0-cd0e7797e92f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.211628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de3c8f34-0b89-4b28-aee0-cd0e7797e92f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.222677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:13.231598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f91463e9-3769-4d05-bd65-36d168bc9b61 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087042 Aug 29 22:51:13.232564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 584/1162] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:13 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:13.243223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-de3c8f34-0b89-4b28-aee0-cd0e7797e92f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Aug 29 22:51:13.243994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 579/1163] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:13.461867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5b66256f-eb63-4848-84ee-5f05db61ded5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:13.464086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5b66256f-eb63-4848-84ee-5f05db61ded5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:13.470381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b66256f-eb63-4848-84ee-5f05db61ded5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.470860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b66256f-eb63-4848-84ee-5f05db61ded5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.471289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b66256f-eb63-4848-84ee-5f05db61ded5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.471983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b66256f-eb63-4848-84ee-5f05db61ded5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.472467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b66256f-eb63-4848-84ee-5f05db61ded5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.472888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5b66256f-eb63-4848-84ee-5f05db61ded5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.504096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5b66256f-eb63-4848-84ee-5f05db61ded5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046385 Aug 29 22:51:13.504689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 585/1164] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:14.099541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9f809cf5-ba9b-4e4e-b262-4b59bb9193f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:14.101781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9f809cf5-ba9b-4e4e-b262-4b59bb9193f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:14.109749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f809cf5-ba9b-4e4e-b262-4b59bb9193f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.110239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f809cf5-ba9b-4e4e-b262-4b59bb9193f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.110679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f809cf5-ba9b-4e4e-b262-4b59bb9193f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.111444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f809cf5-ba9b-4e4e-b262-4b59bb9193f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.111899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f809cf5-ba9b-4e4e-b262-4b59bb9193f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.112361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f809cf5-ba9b-4e4e-b262-4b59bb9193f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.147022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9f809cf5-ba9b-4e4e-b262-4b59bb9193f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051476 Aug 29 22:51:14.147617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 580/1165] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:14.254117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:14.256165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:14.256627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-654dfb9d-cf2c-490a-aaf0-d6513694a625 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:14.259050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-654dfb9d-cf2c-490a-aaf0-d6513694a625 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:14.263337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.263904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.264442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.265411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.265553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-654dfb9d-cf2c-490a-aaf0-d6513694a625 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.265877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-654dfb9d-cf2c-490a-aaf0-d6513694a625 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.266023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.266246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-654dfb9d-cf2c-490a-aaf0-d6513694a625 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.266362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.266950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-654dfb9d-cf2c-490a-aaf0-d6513694a625 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.267404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-654dfb9d-cf2c-490a-aaf0-d6513694a625 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.267825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-654dfb9d-cf2c-490a-aaf0-d6513694a625 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.312313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-654dfb9d-cf2c-490a-aaf0-d6513694a625 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060748 Aug 29 22:51:14.312911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 581/1166] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:14.336860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:14.345785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9b574076-bcd2-480c-9b7e-4d3199c75fc7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.096167 Aug 29 22:51:14.346509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 586/1167] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:14 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:14.519148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d4d418dc-7768-4a12-be7e-d77f24cb5319 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:14.521611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d4d418dc-7768-4a12-be7e-d77f24cb5319 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:14.528538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d418dc-7768-4a12-be7e-d77f24cb5319 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.529020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d418dc-7768-4a12-be7e-d77f24cb5319 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.529456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d418dc-7768-4a12-be7e-d77f24cb5319 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.530158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d418dc-7768-4a12-be7e-d77f24cb5319 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.530618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d418dc-7768-4a12-be7e-d77f24cb5319 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.531037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d4d418dc-7768-4a12-be7e-d77f24cb5319 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.549371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:14.564353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d4d418dc-7768-4a12-be7e-d77f24cb5319 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049276 Aug 29 22:51:14.564942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 582/1168] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:15.159400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-668a4b2f-1370-451c-a11d-0807fd868348 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:15.161961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-668a4b2f-1370-451c-a11d-0807fd868348 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:15.168043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668a4b2f-1370-451c-a11d-0807fd868348 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.168554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668a4b2f-1370-451c-a11d-0807fd868348 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.169189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668a4b2f-1370-451c-a11d-0807fd868348 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:15.169903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668a4b2f-1370-451c-a11d-0807fd868348 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.170295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668a4b2f-1370-451c-a11d-0807fd868348 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.170717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668a4b2f-1370-451c-a11d-0807fd868348 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:15.196461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:15.202713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-668a4b2f-1370-451c-a11d-0807fd868348 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047369 Aug 29 22:51:15.203294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 587/1169] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:15.326984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-487dc61a-74c1-4536-ad66-7af823ae74cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:15.329203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-487dc61a-74c1-4536-ad66-7af823ae74cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:15.337164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-487dc61a-74c1-4536-ad66-7af823ae74cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.337686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-487dc61a-74c1-4536-ad66-7af823ae74cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.338129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-487dc61a-74c1-4536-ad66-7af823ae74cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:15.338835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-487dc61a-74c1-4536-ad66-7af823ae74cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.339276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-487dc61a-74c1-4536-ad66-7af823ae74cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.339700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-487dc61a-74c1-4536-ad66-7af823ae74cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:15.367240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:15.367895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:15.373021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-487dc61a-74c1-4536-ad66-7af823ae74cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050289 Aug 29 22:51:15.373602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 583/1170] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:15.379083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.383078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.383078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:15.383078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.383078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.383477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:15.450791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:15.459805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a33ffe13-0984-423d-adcf-4b23eba4e1b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.096585 Aug 29 22:51:15.460534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 588/1171] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:15 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:15.577232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d6327685-61c0-45e5-a725-3daf20404a2f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:15.579432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d6327685-61c0-45e5-a725-3daf20404a2f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:15.585983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d6327685-61c0-45e5-a725-3daf20404a2f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.586541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d6327685-61c0-45e5-a725-3daf20404a2f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.587009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d6327685-61c0-45e5-a725-3daf20404a2f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:15.587710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d6327685-61c0-45e5-a725-3daf20404a2f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.588190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d6327685-61c0-45e5-a725-3daf20404a2f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.588623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d6327685-61c0-45e5-a725-3daf20404a2f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:15.620393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d6327685-61c0-45e5-a725-3daf20404a2f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046897 Aug 29 22:51:15.621033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 584/1172] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:16.215697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5a55cb49-f608-459e-b77b-7dfdb7e3eb48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:16.217908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5a55cb49-f608-459e-b77b-7dfdb7e3eb48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:16.224620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a55cb49-f608-459e-b77b-7dfdb7e3eb48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.225320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a55cb49-f608-459e-b77b-7dfdb7e3eb48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.225777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a55cb49-f608-459e-b77b-7dfdb7e3eb48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.226519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a55cb49-f608-459e-b77b-7dfdb7e3eb48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.226981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a55cb49-f608-459e-b77b-7dfdb7e3eb48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.227409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a55cb49-f608-459e-b77b-7dfdb7e3eb48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.260748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5a55cb49-f608-459e-b77b-7dfdb7e3eb48 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048984 Aug 29 22:51:16.261337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 589/1173] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:16.385429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f4ebc4ae-727a-41f7-bf9f-0a5819b43b0c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:16.387524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f4ebc4ae-727a-41f7-bf9f-0a5819b43b0c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:16.394243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4ebc4ae-727a-41f7-bf9f-0a5819b43b0c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.394724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4ebc4ae-727a-41f7-bf9f-0a5819b43b0c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.395162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4ebc4ae-727a-41f7-bf9f-0a5819b43b0c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.396593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4ebc4ae-727a-41f7-bf9f-0a5819b43b0c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.397150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4ebc4ae-727a-41f7-bf9f-0a5819b43b0c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.397577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4ebc4ae-727a-41f7-bf9f-0a5819b43b0c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.430407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f4ebc4ae-727a-41f7-bf9f-0a5819b43b0c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049063 Aug 29 22:51:16.430999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 585/1174] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:16.481077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:16.481627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:16.488070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.488597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.489206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.489916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.490375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.490834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.560110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:16.569139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-adc18503-4e34-414c-b160-587cf0f5625e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092000 Aug 29 22:51:16.569831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 590/1175] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:16 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:16.633781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ec95778a-a863-4016-9d40-916c2be9a3fe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:16.635928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ec95778a-a863-4016-9d40-916c2be9a3fe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:16.642705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec95778a-a863-4016-9d40-916c2be9a3fe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.643194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec95778a-a863-4016-9d40-916c2be9a3fe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.643656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec95778a-a863-4016-9d40-916c2be9a3fe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.644454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec95778a-a863-4016-9d40-916c2be9a3fe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.644908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec95778a-a863-4016-9d40-916c2be9a3fe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.645976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec95778a-a863-4016-9d40-916c2be9a3fe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.677816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ec95778a-a863-4016-9d40-916c2be9a3fe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048563 Aug 29 22:51:16.678414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 586/1176] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:17.274253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a1788c37-f0b7-45c2-b884-73050c02d9ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:17.276490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a1788c37-f0b7-45c2-b884-73050c02d9ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:17.282600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1788c37-f0b7-45c2-b884-73050c02d9ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.283167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1788c37-f0b7-45c2-b884-73050c02d9ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.283624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1788c37-f0b7-45c2-b884-73050c02d9ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.284346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1788c37-f0b7-45c2-b884-73050c02d9ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.284793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1788c37-f0b7-45c2-b884-73050c02d9ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.285216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1788c37-f0b7-45c2-b884-73050c02d9ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.317095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a1788c37-f0b7-45c2-b884-73050c02d9ee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047598 Aug 29 22:51:17.318199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 591/1177] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:17.444301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1ce64e14-af70-4c05-9578-eca79cfabb11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:17.446614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1ce64e14-af70-4c05-9578-eca79cfabb11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:17.453979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ce64e14-af70-4c05-9578-eca79cfabb11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.454457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ce64e14-af70-4c05-9578-eca79cfabb11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.454887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ce64e14-af70-4c05-9578-eca79cfabb11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.455989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ce64e14-af70-4c05-9578-eca79cfabb11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.456551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ce64e14-af70-4c05-9578-eca79cfabb11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.457091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ce64e14-af70-4c05-9578-eca79cfabb11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.491648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1ce64e14-af70-4c05-9578-eca79cfabb11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052192 Aug 29 22:51:17.492263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 587/1178] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:17.590616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:17.591229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:17.597977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.598459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.598924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.599587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.600042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.600487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.665468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:17.673682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c83b19de-d48c-4af1-ba9d-d151a891ac62 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086958 Aug 29 22:51:17.674257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 592/1179] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:17 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:17.690668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b82542fc-6eae-4f26-9d27-91c6551a780c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:17.693514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b82542fc-6eae-4f26-9d27-91c6551a780c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:17.699608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b82542fc-6eae-4f26-9d27-91c6551a780c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.700088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b82542fc-6eae-4f26-9d27-91c6551a780c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.700560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b82542fc-6eae-4f26-9d27-91c6551a780c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.701254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b82542fc-6eae-4f26-9d27-91c6551a780c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.701705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b82542fc-6eae-4f26-9d27-91c6551a780c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.702125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b82542fc-6eae-4f26-9d27-91c6551a780c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.733310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b82542fc-6eae-4f26-9d27-91c6551a780c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046507 Aug 29 22:51:17.733871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 588/1180] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:18.331151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-adc441d7-be81-4919-98d6-99dc83541d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:18.334280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-adc441d7-be81-4919-98d6-99dc83541d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:18.340678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc441d7-be81-4919-98d6-99dc83541d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.341163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc441d7-be81-4919-98d6-99dc83541d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.341729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc441d7-be81-4919-98d6-99dc83541d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.342320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc441d7-be81-4919-98d6-99dc83541d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.342777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc441d7-be81-4919-98d6-99dc83541d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.343197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adc441d7-be81-4919-98d6-99dc83541d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.374216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-adc441d7-be81-4919-98d6-99dc83541d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047532 Aug 29 22:51:18.374792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 593/1181] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:18.504870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4c6b3388-858c-4fc0-8edf-dcca712b03c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:18.507385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4c6b3388-858c-4fc0-8edf-dcca712b03c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:18.551954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c6b3388-858c-4fc0-8edf-dcca712b03c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.552478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c6b3388-858c-4fc0-8edf-dcca712b03c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.552913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c6b3388-858c-4fc0-8edf-dcca712b03c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.553622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c6b3388-858c-4fc0-8edf-dcca712b03c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.554072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c6b3388-858c-4fc0-8edf-dcca712b03c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.554494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c6b3388-858c-4fc0-8edf-dcca712b03c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.586110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4c6b3388-858c-4fc0-8edf-dcca712b03c1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085144 Aug 29 22:51:18.586605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 589/1182] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:18.695400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:18.696005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:18.702508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.702989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.703422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.704115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.704592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.705016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.746527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7b7e2c59-5876-4798-bd6b-daa71767a0c5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:18.748719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7b7e2c59-5876-4798-bd6b-daa71767a0c5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:18.754852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b7e2c59-5876-4798-bd6b-daa71767a0c5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.755363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b7e2c59-5876-4798-bd6b-daa71767a0c5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.755811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b7e2c59-5876-4798-bd6b-daa71767a0c5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.756608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b7e2c59-5876-4798-bd6b-daa71767a0c5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.756999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b7e2c59-5876-4798-bd6b-daa71767a0c5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.757422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b7e2c59-5876-4798-bd6b-daa71767a0c5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.772072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:18.780315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2676e281-fe09-41ad-aa6f-0a3e54ba636b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089119 Aug 29 22:51:18.781260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 594/1183] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:18 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:18.792022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7b7e2c59-5876-4798-bd6b-daa71767a0c5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049387 Aug 29 22:51:18.792873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 590/1184] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:19.386897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e067d81e-4760-4565-b7b4-b19b79e049e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:19.389165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e067d81e-4760-4565-b7b4-b19b79e049e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:19.395939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e067d81e-4760-4565-b7b4-b19b79e049e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.396686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e067d81e-4760-4565-b7b4-b19b79e049e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.397136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e067d81e-4760-4565-b7b4-b19b79e049e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.397906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e067d81e-4760-4565-b7b4-b19b79e049e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.398462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e067d81e-4760-4565-b7b4-b19b79e049e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.398962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e067d81e-4760-4565-b7b4-b19b79e049e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.432546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e067d81e-4760-4565-b7b4-b19b79e049e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049772 Aug 29 22:51:19.433134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 595/1185] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:19.598905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-36ca9881-29ff-47e2-8dfb-ba78c65c7997 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:19.601193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-36ca9881-29ff-47e2-8dfb-ba78c65c7997 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:19.607615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36ca9881-29ff-47e2-8dfb-ba78c65c7997 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.608087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36ca9881-29ff-47e2-8dfb-ba78c65c7997 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.608561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36ca9881-29ff-47e2-8dfb-ba78c65c7997 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.609248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36ca9881-29ff-47e2-8dfb-ba78c65c7997 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.609696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36ca9881-29ff-47e2-8dfb-ba78c65c7997 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.610104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36ca9881-29ff-47e2-8dfb-ba78c65c7997 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.641065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-36ca9881-29ff-47e2-8dfb-ba78c65c7997 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046194 Aug 29 22:51:19.641549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 591/1186] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:19.806037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:19.807042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:19.807594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b72abb5d-9eac-40f1-89ba-b71f5e0e5da1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:19.811077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b72abb5d-9eac-40f1-89ba-b71f5e0e5da1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:19.817785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.818571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.819319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.820630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.821290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b72abb5d-9eac-40f1-89ba-b71f5e0e5da1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.821413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.822025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b72abb5d-9eac-40f1-89ba-b71f5e0e5da1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.822173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.822718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b72abb5d-9eac-40f1-89ba-b71f5e0e5da1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.823837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b72abb5d-9eac-40f1-89ba-b71f5e0e5da1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.824627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b72abb5d-9eac-40f1-89ba-b71f5e0e5da1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.825322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b72abb5d-9eac-40f1-89ba-b71f5e0e5da1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.858207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b72abb5d-9eac-40f1-89ba-b71f5e0e5da1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057883 Aug 29 22:51:19.859094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 592/1187] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:19.889111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:19.898733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-120fad72-1b5c-4aa5-b513-662970eb8530 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.099789 Aug 29 22:51:19.899262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 596/1188] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:19 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:20.445845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fac5d776-fc75-4dbd-b90b-b5d41486035f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:20.448077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fac5d776-fc75-4dbd-b90b-b5d41486035f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:20.454081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fac5d776-fc75-4dbd-b90b-b5d41486035f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.454553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fac5d776-fc75-4dbd-b90b-b5d41486035f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.454990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fac5d776-fc75-4dbd-b90b-b5d41486035f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:20.455926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fac5d776-fc75-4dbd-b90b-b5d41486035f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.456406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fac5d776-fc75-4dbd-b90b-b5d41486035f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.456829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fac5d776-fc75-4dbd-b90b-b5d41486035f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:20.487492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fac5d776-fc75-4dbd-b90b-b5d41486035f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046175 Aug 29 22:51:20.488058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 593/1189] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:20.653973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1bcaad6a-bbe5-48b2-a9bc-6a6b0b33dc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:20.656197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1bcaad6a-bbe5-48b2-a9bc-6a6b0b33dc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:20.663130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bcaad6a-bbe5-48b2-a9bc-6a6b0b33dc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.663742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bcaad6a-bbe5-48b2-a9bc-6a6b0b33dc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.664207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bcaad6a-bbe5-48b2-a9bc-6a6b0b33dc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:20.664911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bcaad6a-bbe5-48b2-a9bc-6a6b0b33dc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.665397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bcaad6a-bbe5-48b2-a9bc-6a6b0b33dc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.665821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bcaad6a-bbe5-48b2-a9bc-6a6b0b33dc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:20.712950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1bcaad6a-bbe5-48b2-a9bc-6a6b0b33dc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063030 Aug 29 22:51:20.713449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 597/1190] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:20.871231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7fbc97d7-a3e5-4876-868f-8c8f7cc687bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:20.873415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7fbc97d7-a3e5-4876-868f-8c8f7cc687bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:20.880478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fbc97d7-a3e5-4876-868f-8c8f7cc687bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.880968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fbc97d7-a3e5-4876-868f-8c8f7cc687bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.881402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fbc97d7-a3e5-4876-868f-8c8f7cc687bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:20.882101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fbc97d7-a3e5-4876-868f-8c8f7cc687bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.882784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fbc97d7-a3e5-4876-868f-8c8f7cc687bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.882973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fbc97d7-a3e5-4876-868f-8c8f7cc687bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:20.913727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7fbc97d7-a3e5-4876-868f-8c8f7cc687bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046407 Aug 29 22:51:20.914490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 594/1191] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:20.923639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:20.924284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:20.932060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.932591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.933032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:20.933734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.934255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.934684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.006736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:21.014556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-13916b32-6b65-4e30-813b-54661e14e2a4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094797 Aug 29 22:51:21.015117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 598/1192] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:20 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:21.500184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-61a74394-e1d7-4a0d-b8f8-29326d5f0b27 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:21.502358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-61a74394-e1d7-4a0d-b8f8-29326d5f0b27 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:21.509548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61a74394-e1d7-4a0d-b8f8-29326d5f0b27 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.514994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61a74394-e1d7-4a0d-b8f8-29326d5f0b27 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.514994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61a74394-e1d7-4a0d-b8f8-29326d5f0b27 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.514994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61a74394-e1d7-4a0d-b8f8-29326d5f0b27 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.514994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61a74394-e1d7-4a0d-b8f8-29326d5f0b27 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.515379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61a74394-e1d7-4a0d-b8f8-29326d5f0b27 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.543985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-61a74394-e1d7-4a0d-b8f8-29326d5f0b27 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047738 Aug 29 22:51:21.544581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 595/1193] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:21.726363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-76643691-8714-40d3-84d4-71bbf76ce6ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:21.729299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-76643691-8714-40d3-84d4-71bbf76ce6ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:21.734871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76643691-8714-40d3-84d4-71bbf76ce6ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.735357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76643691-8714-40d3-84d4-71bbf76ce6ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.735792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76643691-8714-40d3-84d4-71bbf76ce6ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.736535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76643691-8714-40d3-84d4-71bbf76ce6ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.736990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76643691-8714-40d3-84d4-71bbf76ce6ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.737411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76643691-8714-40d3-84d4-71bbf76ce6ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.768445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-76643691-8714-40d3-84d4-71bbf76ce6ed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047008 Aug 29 22:51:21.769365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 599/1194] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:21 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:21.926076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4ed7728f-0ded-4276-8df0-998a7703f6e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:21.928368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4ed7728f-0ded-4276-8df0-998a7703f6e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:21.935089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed7728f-0ded-4276-8df0-998a7703f6e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.935566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed7728f-0ded-4276-8df0-998a7703f6e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.935993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed7728f-0ded-4276-8df0-998a7703f6e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.936741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed7728f-0ded-4276-8df0-998a7703f6e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.937185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed7728f-0ded-4276-8df0-998a7703f6e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.937607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ed7728f-0ded-4276-8df0-998a7703f6e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.972742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4ed7728f-0ded-4276-8df0-998a7703f6e0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050554 Aug 29 22:51:21.973446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 596/1195] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:22.035119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:22.035724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:22.045134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.045134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.045134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:22.045134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.045745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.045745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:22.114987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:22.123850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-093165ae-0236-447d-a3c3-69b00e720493 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092727 Aug 29 22:51:22.124708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 600/1196] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:22 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:22.555911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82d606b3-0d5a-4ce6-92a7-b5f32248a7b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:22.558109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82d606b3-0d5a-4ce6-92a7-b5f32248a7b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:22.564206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82d606b3-0d5a-4ce6-92a7-b5f32248a7b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.564683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82d606b3-0d5a-4ce6-92a7-b5f32248a7b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.565112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82d606b3-0d5a-4ce6-92a7-b5f32248a7b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:22.565805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82d606b3-0d5a-4ce6-92a7-b5f32248a7b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.566253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82d606b3-0d5a-4ce6-92a7-b5f32248a7b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.566672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82d606b3-0d5a-4ce6-92a7-b5f32248a7b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:22.599766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82d606b3-0d5a-4ce6-92a7-b5f32248a7b1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047922 Aug 29 22:51:22.600380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 597/1197] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:22.780877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cce65df3-d024-4459-b67d-ab7523fc0757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:22.783059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cce65df3-d024-4459-b67d-ab7523fc0757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:22.789754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cce65df3-d024-4459-b67d-ab7523fc0757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.790228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cce65df3-d024-4459-b67d-ab7523fc0757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.790659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cce65df3-d024-4459-b67d-ab7523fc0757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:22.791350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cce65df3-d024-4459-b67d-ab7523fc0757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.791800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cce65df3-d024-4459-b67d-ab7523fc0757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.792247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cce65df3-d024-4459-b67d-ab7523fc0757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:22.823030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cce65df3-d024-4459-b67d-ab7523fc0757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045965 Aug 29 22:51:22.823498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 601/1198] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:22.984746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e9ec8943-79de-4c1f-804d-4989dff7ef2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:22.986900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e9ec8943-79de-4c1f-804d-4989dff7ef2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:22.994639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9ec8943-79de-4c1f-804d-4989dff7ef2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.995147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9ec8943-79de-4c1f-804d-4989dff7ef2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.995575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9ec8943-79de-4c1f-804d-4989dff7ef2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:22.996301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9ec8943-79de-4c1f-804d-4989dff7ef2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.996746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9ec8943-79de-4c1f-804d-4989dff7ef2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.997158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e9ec8943-79de-4c1f-804d-4989dff7ef2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.028563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e9ec8943-79de-4c1f-804d-4989dff7ef2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047951 Aug 29 22:51:23.029122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 598/1199] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:23.145438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:23.146067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:23.153556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:23.154036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:23.154464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.155153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:23.155598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:23.156013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.218686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:23.228613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dfc4b92d-7ff8-4139-a65d-356a16b62469 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086445 Aug 29 22:51:23.229183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 602/1200] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:23 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:23.612787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-311f0f2b-5921-4552-a412-43b0571667de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:23.615240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-311f0f2b-5921-4552-a412-43b0571667de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:23.621954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0f2b-5921-4552-a412-43b0571667de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:23.622442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0f2b-5921-4552-a412-43b0571667de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:23.622942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0f2b-5921-4552-a412-43b0571667de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.623590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0f2b-5921-4552-a412-43b0571667de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:23.624044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0f2b-5921-4552-a412-43b0571667de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:23.624533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0f2b-5921-4552-a412-43b0571667de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.628543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:23.671563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-311f0f2b-5921-4552-a412-43b0571667de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063141 Aug 29 22:51:23.672159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 599/1201] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:23.835740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-376a0f25-2afe-4dc8-9ef3-77c2b0235a33 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:23.838005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-376a0f25-2afe-4dc8-9ef3-77c2b0235a33 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:23.844830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-376a0f25-2afe-4dc8-9ef3-77c2b0235a33 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:23.849861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-376a0f25-2afe-4dc8-9ef3-77c2b0235a33 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:23.849861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-376a0f25-2afe-4dc8-9ef3-77c2b0235a33 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.849861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-376a0f25-2afe-4dc8-9ef3-77c2b0235a33 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:23.849861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-376a0f25-2afe-4dc8-9ef3-77c2b0235a33 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:23.850256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-376a0f25-2afe-4dc8-9ef3-77c2b0235a33 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.878809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-376a0f25-2afe-4dc8-9ef3-77c2b0235a33 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047149 Aug 29 22:51:23.879383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 603/1202] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:24.042030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5a703f53-1646-45eb-be73-8c7920be48ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:24.044193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5a703f53-1646-45eb-be73-8c7920be48ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:24.051055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a703f53-1646-45eb-be73-8c7920be48ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.052261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a703f53-1646-45eb-be73-8c7920be48ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.052976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a703f53-1646-45eb-be73-8c7920be48ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.053685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a703f53-1646-45eb-be73-8c7920be48ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.054145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a703f53-1646-45eb-be73-8c7920be48ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.054566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a703f53-1646-45eb-be73-8c7920be48ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.086647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5a703f53-1646-45eb-be73-8c7920be48ac tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048563 Aug 29 22:51:24.087141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 600/1203] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:24.248812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:24.249418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:24.255616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.256104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.256658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.257459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.257917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.258354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.274198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:24.324297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:24.333512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-17c6306c-80de-4ebb-8c2c-773248139cd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088159 Aug 29 22:51:24.334256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 604/1204] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:24 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:24.684192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-253b8d49-80e0-4fb4-9688-a7e1b44553ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:24.686376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-253b8d49-80e0-4fb4-9688-a7e1b44553ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:24.692522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253b8d49-80e0-4fb4-9688-a7e1b44553ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.693007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253b8d49-80e0-4fb4-9688-a7e1b44553ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.693651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253b8d49-80e0-4fb4-9688-a7e1b44553ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.694589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253b8d49-80e0-4fb4-9688-a7e1b44553ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.695134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253b8d49-80e0-4fb4-9688-a7e1b44553ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.695557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253b8d49-80e0-4fb4-9688-a7e1b44553ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.728908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-253b8d49-80e0-4fb4-9688-a7e1b44553ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048672 Aug 29 22:51:24.729501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 601/1205] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:24.892080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-97ca457a-c1da-4cf0-bc4c-eced98d523a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:24.894180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-97ca457a-c1da-4cf0-bc4c-eced98d523a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:24.901499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97ca457a-c1da-4cf0-bc4c-eced98d523a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.901972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97ca457a-c1da-4cf0-bc4c-eced98d523a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.902400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97ca457a-c1da-4cf0-bc4c-eced98d523a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.903093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97ca457a-c1da-4cf0-bc4c-eced98d523a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.903539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97ca457a-c1da-4cf0-bc4c-eced98d523a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.903950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97ca457a-c1da-4cf0-bc4c-eced98d523a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.935443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-97ca457a-c1da-4cf0-bc4c-eced98d523a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047415 Aug 29 22:51:24.936009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 605/1206] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:25.099150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3198e8e0-dfec-4bfa-ad0c-0a60f7c52a83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:25.101453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3198e8e0-dfec-4bfa-ad0c-0a60f7c52a83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:25.107964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3198e8e0-dfec-4bfa-ad0c-0a60f7c52a83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.108469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3198e8e0-dfec-4bfa-ad0c-0a60f7c52a83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.108896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3198e8e0-dfec-4bfa-ad0c-0a60f7c52a83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.109583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3198e8e0-dfec-4bfa-ad0c-0a60f7c52a83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.110028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3198e8e0-dfec-4bfa-ad0c-0a60f7c52a83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.110443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3198e8e0-dfec-4bfa-ad0c-0a60f7c52a83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.142535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3198e8e0-dfec-4bfa-ad0c-0a60f7c52a83 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047276 Aug 29 22:51:25.143185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 602/1207] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:25.355184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:25.355812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:25.361934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.362415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.362849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.363540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.364031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.364824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.431760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:25.439684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2b7bdec2-85ac-40f9-a503-2fb7390fdd45 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088388 Aug 29 22:51:25.440291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 606/1208] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:25.741988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a3a579af-336f-45a0-b465-a263fc35b1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:25.744088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a3a579af-336f-45a0-b465-a263fc35b1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:25.750283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3a579af-336f-45a0-b465-a263fc35b1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.750771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3a579af-336f-45a0-b465-a263fc35b1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.751204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3a579af-336f-45a0-b465-a263fc35b1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.751897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3a579af-336f-45a0-b465-a263fc35b1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.752387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3a579af-336f-45a0-b465-a263fc35b1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.752810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3a579af-336f-45a0-b465-a263fc35b1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.784261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a3a579af-336f-45a0-b465-a263fc35b1d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047376 Aug 29 22:51:25.784833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 603/1209] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:25.947431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6dd768fa-6e48-40b6-b0d2-2e1085f71667 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:25.949622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6dd768fa-6e48-40b6-b0d2-2e1085f71667 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:25.956321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dd768fa-6e48-40b6-b0d2-2e1085f71667 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.956798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dd768fa-6e48-40b6-b0d2-2e1085f71667 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.957231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dd768fa-6e48-40b6-b0d2-2e1085f71667 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.958720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dd768fa-6e48-40b6-b0d2-2e1085f71667 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.959349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dd768fa-6e48-40b6-b0d2-2e1085f71667 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.959772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dd768fa-6e48-40b6-b0d2-2e1085f71667 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.992890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6dd768fa-6e48-40b6-b0d2-2e1085f71667 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049235 Aug 29 22:51:25.993375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 607/1210] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:26.155835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b35c7269-af14-4d7b-85b7-b5fd210b8b77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:26.158154 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b35c7269-af14-4d7b-85b7-b5fd210b8b77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:26.173303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b35c7269-af14-4d7b-85b7-b5fd210b8b77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:26.173828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b35c7269-af14-4d7b-85b7-b5fd210b8b77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:26.174256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b35c7269-af14-4d7b-85b7-b5fd210b8b77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.175665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b35c7269-af14-4d7b-85b7-b5fd210b8b77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:26.175665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b35c7269-af14-4d7b-85b7-b5fd210b8b77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:26.175871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b35c7269-af14-4d7b-85b7-b5fd210b8b77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.209434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b35c7269-af14-4d7b-85b7-b5fd210b8b77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057540 Aug 29 22:51:26.210025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 604/1211] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:26.461389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:26.463012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:26.468240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:26.468728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:26.469172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.469872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:26.470327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:26.470761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.533903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:26.542265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9018a926-7003-4511-aec1-403bf7e57db7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085716 Aug 29 22:51:26.542846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 608/1212] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:26.797566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fdcc8b99-b71f-4c68-8013-ffea88a9f3fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:26.800070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fdcc8b99-b71f-4c68-8013-ffea88a9f3fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:26.807409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdcc8b99-b71f-4c68-8013-ffea88a9f3fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:26.807891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdcc8b99-b71f-4c68-8013-ffea88a9f3fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:26.808373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdcc8b99-b71f-4c68-8013-ffea88a9f3fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.809155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdcc8b99-b71f-4c68-8013-ffea88a9f3fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:26.809645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdcc8b99-b71f-4c68-8013-ffea88a9f3fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:26.810066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdcc8b99-b71f-4c68-8013-ffea88a9f3fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.843456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fdcc8b99-b71f-4c68-8013-ffea88a9f3fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050012 Aug 29 22:51:26.844040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 605/1213] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:27.005918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-21db17c6-04b7-44b9-9301-4718fc7bd775 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:27.008130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-21db17c6-04b7-44b9-9301-4718fc7bd775 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:27.014822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21db17c6-04b7-44b9-9301-4718fc7bd775 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.015299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21db17c6-04b7-44b9-9301-4718fc7bd775 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.015730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21db17c6-04b7-44b9-9301-4718fc7bd775 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.016460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21db17c6-04b7-44b9-9301-4718fc7bd775 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.016914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21db17c6-04b7-44b9-9301-4718fc7bd775 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.017340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21db17c6-04b7-44b9-9301-4718fc7bd775 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.048827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-21db17c6-04b7-44b9-9301-4718fc7bd775 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047565 Aug 29 22:51:27.049309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 609/1214] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:27.221866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dbaf21e6-56f3-4b03-a298-d4258d2daa4f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:27.224874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dbaf21e6-56f3-4b03-a298-d4258d2daa4f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:27.231833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbaf21e6-56f3-4b03-a298-d4258d2daa4f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.232349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbaf21e6-56f3-4b03-a298-d4258d2daa4f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.232779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbaf21e6-56f3-4b03-a298-d4258d2daa4f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.233481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbaf21e6-56f3-4b03-a298-d4258d2daa4f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.233934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbaf21e6-56f3-4b03-a298-d4258d2daa4f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.234351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbaf21e6-56f3-4b03-a298-d4258d2daa4f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.268695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dbaf21e6-56f3-4b03-a298-d4258d2daa4f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050849 Aug 29 22:51:27.269318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 606/1215] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:27.563031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:27.563702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:27.569699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.570175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.570601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.571287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.571732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.572184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.633769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:27.641441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-544420a0-8b81-40c0-ae89-0e150435d917 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.082283 Aug 29 22:51:27.642013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 610/1216] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:27 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:27.856506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-13b855b9-4077-4a47-8079-231895e4d712 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:27.858599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-13b855b9-4077-4a47-8079-231895e4d712 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:27.864927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13b855b9-4077-4a47-8079-231895e4d712 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.865407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13b855b9-4077-4a47-8079-231895e4d712 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.865827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13b855b9-4077-4a47-8079-231895e4d712 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.866525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13b855b9-4077-4a47-8079-231895e4d712 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.866964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13b855b9-4077-4a47-8079-231895e4d712 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.867385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13b855b9-4077-4a47-8079-231895e4d712 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.897862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-13b855b9-4077-4a47-8079-231895e4d712 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045787 Aug 29 22:51:27.898429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 607/1217] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:28.061862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8a692fee-36b0-4ab0-96d2-c12daf19a5e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:28.064018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8a692fee-36b0-4ab0-96d2-c12daf19a5e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:28.071176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a692fee-36b0-4ab0-96d2-c12daf19a5e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.071660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a692fee-36b0-4ab0-96d2-c12daf19a5e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.072095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a692fee-36b0-4ab0-96d2-c12daf19a5e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.072823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a692fee-36b0-4ab0-96d2-c12daf19a5e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.073277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a692fee-36b0-4ab0-96d2-c12daf19a5e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.073702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a692fee-36b0-4ab0-96d2-c12daf19a5e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.105110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8a692fee-36b0-4ab0-96d2-c12daf19a5e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047142 Aug 29 22:51:28.105693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 611/1218] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:28.281871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-acf0d85b-796a-464d-9d98-87b63fdcbafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:28.283987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-acf0d85b-796a-464d-9d98-87b63fdcbafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:28.290403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acf0d85b-796a-464d-9d98-87b63fdcbafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.290878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acf0d85b-796a-464d-9d98-87b63fdcbafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.291300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acf0d85b-796a-464d-9d98-87b63fdcbafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.291986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acf0d85b-796a-464d-9d98-87b63fdcbafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.292459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acf0d85b-796a-464d-9d98-87b63fdcbafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.292869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acf0d85b-796a-464d-9d98-87b63fdcbafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.323925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-acf0d85b-796a-464d-9d98-87b63fdcbafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 Aug 29 22:51:28.324518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 608/1219] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:28.662657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:28.663245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:28.669292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.669766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.670198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.670880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.671331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.671749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.735658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:28.744875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-96b20533-5422-44cf-a609-cc8bb7cbbfc3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086199 Aug 29 22:51:28.745668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 612/1220] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:28 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:28.910012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5b9537e0-869e-4e6e-a7f3-a634cce859c6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:28.915204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5b9537e0-869e-4e6e-a7f3-a634cce859c6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:28.919196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9537e0-869e-4e6e-a7f3-a634cce859c6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.919680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9537e0-869e-4e6e-a7f3-a634cce859c6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.920388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9537e0-869e-4e6e-a7f3-a634cce859c6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.920831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9537e0-869e-4e6e-a7f3-a634cce859c6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.921283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9537e0-869e-4e6e-a7f3-a634cce859c6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.921707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9537e0-869e-4e6e-a7f3-a634cce859c6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.954185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5b9537e0-869e-4e6e-a7f3-a634cce859c6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048274 Aug 29 22:51:28.954765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 609/1221] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:29.117886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4da3de4f-9676-44d7-8478-11f8a582659a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:29.120053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4da3de4f-9676-44d7-8478-11f8a582659a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:29.126596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4da3de4f-9676-44d7-8478-11f8a582659a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.127076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4da3de4f-9676-44d7-8478-11f8a582659a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.127529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4da3de4f-9676-44d7-8478-11f8a582659a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.128237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4da3de4f-9676-44d7-8478-11f8a582659a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.128691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4da3de4f-9676-44d7-8478-11f8a582659a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.129109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4da3de4f-9676-44d7-8478-11f8a582659a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.161126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4da3de4f-9676-44d7-8478-11f8a582659a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047577 Aug 29 22:51:29.161705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 613/1222] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:29.336651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-64abeee7-abc2-40b9-b151-e417acb4d06e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:29.338732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-64abeee7-abc2-40b9-b151-e417acb4d06e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:29.345225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64abeee7-abc2-40b9-b151-e417acb4d06e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.345709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64abeee7-abc2-40b9-b151-e417acb4d06e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.346138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64abeee7-abc2-40b9-b151-e417acb4d06e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.346835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64abeee7-abc2-40b9-b151-e417acb4d06e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.347284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64abeee7-abc2-40b9-b151-e417acb4d06e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.347701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64abeee7-abc2-40b9-b151-e417acb4d06e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.379407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-64abeee7-abc2-40b9-b151-e417acb4d06e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047567 Aug 29 22:51:29.380335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 610/1223] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:29.769274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:29.769871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:29.778924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.779480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.779955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.780920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.781261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.781816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.861788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:29.870874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-35352f4e-8320-4956-a3f1-13b83aa98193 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.105417 Aug 29 22:51:29.871470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 614/1224] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:29 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:29.967364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3bdde963-0482-49ec-88aa-14a170385194 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:29.969533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3bdde963-0482-49ec-88aa-14a170385194 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:29.975720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bdde963-0482-49ec-88aa-14a170385194 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.976258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bdde963-0482-49ec-88aa-14a170385194 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.977719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bdde963-0482-49ec-88aa-14a170385194 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.977719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bdde963-0482-49ec-88aa-14a170385194 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.977934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bdde963-0482-49ec-88aa-14a170385194 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.978248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bdde963-0482-49ec-88aa-14a170385194 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.011872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3bdde963-0482-49ec-88aa-14a170385194 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048448 Aug 29 22:51:30.012486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 611/1225] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:30.173348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e8f6e31e-0469-4400-a369-fb17e2b9273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:30.175536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e8f6e31e-0469-4400-a369-fb17e2b9273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:30.182812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8f6e31e-0469-4400-a369-fb17e2b9273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.183334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8f6e31e-0469-4400-a369-fb17e2b9273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.183772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8f6e31e-0469-4400-a369-fb17e2b9273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.184709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8f6e31e-0469-4400-a369-fb17e2b9273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.185171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8f6e31e-0469-4400-a369-fb17e2b9273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.185599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8f6e31e-0469-4400-a369-fb17e2b9273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.218633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e8f6e31e-0469-4400-a369-fb17e2b9273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049250 Aug 29 22:51:30.219205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 615/1226] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:30.392367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2a8f8a79-22e3-4f7b-bcd0-560388c8f1a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:30.394775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2a8f8a79-22e3-4f7b-bcd0-560388c8f1a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:30.403934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a8f8a79-22e3-4f7b-bcd0-560388c8f1a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.404450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a8f8a79-22e3-4f7b-bcd0-560388c8f1a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.404890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a8f8a79-22e3-4f7b-bcd0-560388c8f1a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.405741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a8f8a79-22e3-4f7b-bcd0-560388c8f1a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.406434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a8f8a79-22e3-4f7b-bcd0-560388c8f1a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.406960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a8f8a79-22e3-4f7b-bcd0-560388c8f1a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.442943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2a8f8a79-22e3-4f7b-bcd0-560388c8f1a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053972 Aug 29 22:51:30.443677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 612/1227] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:30.892978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:30.893601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:30.900468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.900953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.901389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.902085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.902541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.902963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.966536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:30.974731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4a01d94a-2a9c-4c7d-9d52-808dc2e75265 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085653 Aug 29 22:51:30.975346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 616/1228] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:30 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:31.025226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-969e0f44-062c-4ca0-b2ab-c46628454b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:31.027341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-969e0f44-062c-4ca0-b2ab-c46628454b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:31.033302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-969e0f44-062c-4ca0-b2ab-c46628454b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:31.033772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-969e0f44-062c-4ca0-b2ab-c46628454b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:31.034197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-969e0f44-062c-4ca0-b2ab-c46628454b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:31.034877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-969e0f44-062c-4ca0-b2ab-c46628454b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:31.035322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-969e0f44-062c-4ca0-b2ab-c46628454b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:31.035761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-969e0f44-062c-4ca0-b2ab-c46628454b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:31.064678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-969e0f44-062c-4ca0-b2ab-c46628454b5b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043444 Aug 29 22:51:31.065242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 613/1229] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:31.230608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e8e93e51-a151-487f-8a15-a39b76f9b4f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:31.232696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e8e93e51-a151-487f-8a15-a39b76f9b4f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:31.239896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e93e51-a151-487f-8a15-a39b76f9b4f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:31.240444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e93e51-a151-487f-8a15-a39b76f9b4f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:31.240883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e93e51-a151-487f-8a15-a39b76f9b4f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:31.241582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e93e51-a151-487f-8a15-a39b76f9b4f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:31.242036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e93e51-a151-487f-8a15-a39b76f9b4f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:31.242463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e93e51-a151-487f-8a15-a39b76f9b4f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:31.273313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e8e93e51-a151-487f-8a15-a39b76f9b4f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046743 Aug 29 22:51:31.273884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 617/1230] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:31.456026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e138c645-d704-40ef-a19d-a3bfebbe7c19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:31.458235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e138c645-d704-40ef-a19d-a3bfebbe7c19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:31.464815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e138c645-d704-40ef-a19d-a3bfebbe7c19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:31.465304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e138c645-d704-40ef-a19d-a3bfebbe7c19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:31.465743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e138c645-d704-40ef-a19d-a3bfebbe7c19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:31.466445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e138c645-d704-40ef-a19d-a3bfebbe7c19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:31.466903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e138c645-d704-40ef-a19d-a3bfebbe7c19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:31.467331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e138c645-d704-40ef-a19d-a3bfebbe7c19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:31.499102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e138c645-d704-40ef-a19d-a3bfebbe7c19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047193 Aug 29 22:51:31.499576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 614/1231] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:31.994937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:31.995554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:32.001546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.002030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.002473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.003169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.003626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.004053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.068160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:32.076107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8dcd0eb3-329d-43f0-863f-e023781ac74b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084987 Aug 29 22:51:32.076690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 618/1232] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:31 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:32.077108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-32245d28-74a2-4e6b-ae2d-cbe8e5cb3a99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:32.079323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-32245d28-74a2-4e6b-ae2d-cbe8e5cb3a99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:32.081587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:32.087254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32245d28-74a2-4e6b-ae2d-cbe8e5cb3a99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.087751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32245d28-74a2-4e6b-ae2d-cbe8e5cb3a99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.088208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32245d28-74a2-4e6b-ae2d-cbe8e5cb3a99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.088921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32245d28-74a2-4e6b-ae2d-cbe8e5cb3a99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.089376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32245d28-74a2-4e6b-ae2d-cbe8e5cb3a99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.089800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32245d28-74a2-4e6b-ae2d-cbe8e5cb3a99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.116466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:32.121364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-32245d28-74a2-4e6b-ae2d-cbe8e5cb3a99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048213 Aug 29 22:51:32.121938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 615/1233] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:32.286279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9543bb77-047d-48da-bcfa-7a9adf1d2bb1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:32.288542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9543bb77-047d-48da-bcfa-7a9adf1d2bb1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:32.295033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9543bb77-047d-48da-bcfa-7a9adf1d2bb1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.295508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9543bb77-047d-48da-bcfa-7a9adf1d2bb1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.295934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9543bb77-047d-48da-bcfa-7a9adf1d2bb1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.296652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9543bb77-047d-48da-bcfa-7a9adf1d2bb1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.297104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9543bb77-047d-48da-bcfa-7a9adf1d2bb1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.297528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9543bb77-047d-48da-bcfa-7a9adf1d2bb1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.335664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9543bb77-047d-48da-bcfa-7a9adf1d2bb1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053681 Aug 29 22:51:32.336164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 619/1234] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:32.512029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2a7298a9-e5a2-422f-868b-76536094ec86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:32.514241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2a7298a9-e5a2-422f-868b-76536094ec86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:32.521786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a7298a9-e5a2-422f-868b-76536094ec86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.522257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a7298a9-e5a2-422f-868b-76536094ec86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.522687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a7298a9-e5a2-422f-868b-76536094ec86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.523370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a7298a9-e5a2-422f-868b-76536094ec86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.523836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a7298a9-e5a2-422f-868b-76536094ec86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.524260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a7298a9-e5a2-422f-868b-76536094ec86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.554942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2a7298a9-e5a2-422f-868b-76536094ec86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047238 Aug 29 22:51:32.555506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 616/1235] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:33.097659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:33.098872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:33.105034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.105520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.105952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.106646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.107097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.107519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.134818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c8eba6ef-a91f-4061-a7cc-6828af0574f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:33.137045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c8eba6ef-a91f-4061-a7cc-6828af0574f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:33.143571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8eba6ef-a91f-4061-a7cc-6828af0574f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.144130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8eba6ef-a91f-4061-a7cc-6828af0574f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.144592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8eba6ef-a91f-4061-a7cc-6828af0574f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.145341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8eba6ef-a91f-4061-a7cc-6828af0574f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.146050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8eba6ef-a91f-4061-a7cc-6828af0574f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.146724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8eba6ef-a91f-4061-a7cc-6828af0574f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.171712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:33.179984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c8eba6ef-a91f-4061-a7cc-6828af0574f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049829 Aug 29 22:51:33.180628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 617/1236] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:33.180940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-064c7dad-8f26-4734-a02d-c07688cf8e28 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087065 Aug 29 22:51:33.181608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 620/1237] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:33 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:33.348906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-811f6248-f803-4bf4-9aa7-405b1415a994 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:33.351227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-811f6248-f803-4bf4-9aa7-405b1415a994 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:33.357794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-811f6248-f803-4bf4-9aa7-405b1415a994 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.358276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-811f6248-f803-4bf4-9aa7-405b1415a994 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.358701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-811f6248-f803-4bf4-9aa7-405b1415a994 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.359945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-811f6248-f803-4bf4-9aa7-405b1415a994 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.359945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-811f6248-f803-4bf4-9aa7-405b1415a994 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.360454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-811f6248-f803-4bf4-9aa7-405b1415a994 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.394181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-811f6248-f803-4bf4-9aa7-405b1415a994 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049955 Aug 29 22:51:33.394912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 618/1238] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:33.568563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-840c1e1a-6666-4681-b831-30569076bdbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:33.570698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-840c1e1a-6666-4681-b831-30569076bdbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:33.577330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-840c1e1a-6666-4681-b831-30569076bdbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.577819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-840c1e1a-6666-4681-b831-30569076bdbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.578258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-840c1e1a-6666-4681-b831-30569076bdbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.578960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-840c1e1a-6666-4681-b831-30569076bdbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.579421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-840c1e1a-6666-4681-b831-30569076bdbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.579847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-840c1e1a-6666-4681-b831-30569076bdbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.582827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:33.612254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-840c1e1a-6666-4681-b831-30569076bdbf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048784 Aug 29 22:51:33.612833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 621/1239] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:34.193570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d30d8dc7-c734-4109-be74-a5a00837b53a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:34.195723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d30d8dc7-c734-4109-be74-a5a00837b53a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:34.202412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d30d8dc7-c734-4109-be74-a5a00837b53a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.202620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:34.203127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d30d8dc7-c734-4109-be74-a5a00837b53a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.203237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:34.203347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d30d8dc7-c734-4109-be74-a5a00837b53a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.204004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d30d8dc7-c734-4109-be74-a5a00837b53a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.204484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d30d8dc7-c734-4109-be74-a5a00837b53a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.204911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d30d8dc7-c734-4109-be74-a5a00837b53a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.205613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:34.211601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.219853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.219853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.219853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.219853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.220300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.238090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d30d8dc7-c734-4109-be74-a5a00837b53a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049422 Aug 29 22:51:34.239176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 619/1240] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:34.280677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:34.288911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0f434902-e831-4544-b2e7-4507894fcb9b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090117 Aug 29 22:51:34.289497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 622/1241] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:34 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:34.406962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c0982619-eb7f-4a1a-8224-a440c321b9fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:34.409156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c0982619-eb7f-4a1a-8224-a440c321b9fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:34.415988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0982619-eb7f-4a1a-8224-a440c321b9fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.416510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0982619-eb7f-4a1a-8224-a440c321b9fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.416920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0982619-eb7f-4a1a-8224-a440c321b9fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.417614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0982619-eb7f-4a1a-8224-a440c321b9fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.418061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0982619-eb7f-4a1a-8224-a440c321b9fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.418486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0982619-eb7f-4a1a-8224-a440c321b9fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.450369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c0982619-eb7f-4a1a-8224-a440c321b9fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047300 Aug 29 22:51:34.450850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 620/1242] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:34.625201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3e4035a4-1885-41f8-a6f8-afb02d436b23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:34.627345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3e4035a4-1885-41f8-a6f8-afb02d436b23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:34.634056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e4035a4-1885-41f8-a6f8-afb02d436b23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.634536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e4035a4-1885-41f8-a6f8-afb02d436b23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.634970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e4035a4-1885-41f8-a6f8-afb02d436b23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.635662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e4035a4-1885-41f8-a6f8-afb02d436b23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.636110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e4035a4-1885-41f8-a6f8-afb02d436b23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.636566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3e4035a4-1885-41f8-a6f8-afb02d436b23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.667169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3e4035a4-1885-41f8-a6f8-afb02d436b23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045813 Aug 29 22:51:34.667742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 623/1243] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:35.251940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ccbd84ca-e413-4c7e-abc0-52e9aaf95f06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:35.254214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ccbd84ca-e413-4c7e-abc0-52e9aaf95f06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:35.261488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccbd84ca-e413-4c7e-abc0-52e9aaf95f06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.261964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccbd84ca-e413-4c7e-abc0-52e9aaf95f06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.262393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccbd84ca-e413-4c7e-abc0-52e9aaf95f06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.263093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccbd84ca-e413-4c7e-abc0-52e9aaf95f06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.263534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccbd84ca-e413-4c7e-abc0-52e9aaf95f06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.263947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccbd84ca-e413-4c7e-abc0-52e9aaf95f06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.296202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ccbd84ca-e413-4c7e-abc0-52e9aaf95f06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048549 Aug 29 22:51:35.296775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 621/1244] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:35.310797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:35.311403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:35.318004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.318498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.318937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.319645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.320101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.320550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.386263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:35.394914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e1027a0f-6bdc-4607-b92b-2f61614a79bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087954 Aug 29 22:51:35.395520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 624/1245] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:35 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:35.464462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dbd93b57-52c1-4bfa-a1af-725c1f3110a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:35.470030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dbd93b57-52c1-4bfa-a1af-725c1f3110a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:35.472661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbd93b57-52c1-4bfa-a1af-725c1f3110a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.473653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbd93b57-52c1-4bfa-a1af-725c1f3110a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.474064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbd93b57-52c1-4bfa-a1af-725c1f3110a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.474754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbd93b57-52c1-4bfa-a1af-725c1f3110a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.475198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbd93b57-52c1-4bfa-a1af-725c1f3110a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.475618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbd93b57-52c1-4bfa-a1af-725c1f3110a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.507189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dbd93b57-52c1-4bfa-a1af-725c1f3110a4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046675 Aug 29 22:51:35.507674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 622/1246] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:35.680457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a260d14e-04a2-4d2d-9d2f-38bb0df08630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:35.682618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a260d14e-04a2-4d2d-9d2f-38bb0df08630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:35.689205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a260d14e-04a2-4d2d-9d2f-38bb0df08630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.689695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a260d14e-04a2-4d2d-9d2f-38bb0df08630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.690123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a260d14e-04a2-4d2d-9d2f-38bb0df08630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.690816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a260d14e-04a2-4d2d-9d2f-38bb0df08630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.691268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a260d14e-04a2-4d2d-9d2f-38bb0df08630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.691707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a260d14e-04a2-4d2d-9d2f-38bb0df08630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.724567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a260d14e-04a2-4d2d-9d2f-38bb0df08630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048567 Aug 29 22:51:35.725171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 625/1247] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:36.308971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-77034b53-fc35-4db8-b8cf-9c77f036a949 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:36.311103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-77034b53-fc35-4db8-b8cf-9c77f036a949 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:36.318096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77034b53-fc35-4db8-b8cf-9c77f036a949 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.318650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77034b53-fc35-4db8-b8cf-9c77f036a949 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.319122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77034b53-fc35-4db8-b8cf-9c77f036a949 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.319848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77034b53-fc35-4db8-b8cf-9c77f036a949 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.320399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77034b53-fc35-4db8-b8cf-9c77f036a949 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.320860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77034b53-fc35-4db8-b8cf-9c77f036a949 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.352502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-77034b53-fc35-4db8-b8cf-9c77f036a949 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047675 Aug 29 22:51:36.353077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 623/1248] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:36.415675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:36.416287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:36.422413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.422838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.423268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.424061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.424434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.424957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.490451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:36.498183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4e14f883-ff54-4dc9-a4e0-007d8ca246d0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086387 Aug 29 22:51:36.498743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 626/1249] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:36 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:36.519155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7174c537-7e5f-4681-a230-4bf473dc72cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:36.521927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7174c537-7e5f-4681-a230-4bf473dc72cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:36.528286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7174c537-7e5f-4681-a230-4bf473dc72cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.528796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7174c537-7e5f-4681-a230-4bf473dc72cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.529214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7174c537-7e5f-4681-a230-4bf473dc72cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.529924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7174c537-7e5f-4681-a230-4bf473dc72cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.530374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7174c537-7e5f-4681-a230-4bf473dc72cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.530800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7174c537-7e5f-4681-a230-4bf473dc72cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.561841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7174c537-7e5f-4681-a230-4bf473dc72cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 Aug 29 22:51:36.562322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 624/1250] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:36.738498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-da1ec9e6-a8a2-4576-bc65-af255b2594e6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:36.741169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-da1ec9e6-a8a2-4576-bc65-af255b2594e6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:36.747780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da1ec9e6-a8a2-4576-bc65-af255b2594e6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.748290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da1ec9e6-a8a2-4576-bc65-af255b2594e6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.748729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da1ec9e6-a8a2-4576-bc65-af255b2594e6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.749431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da1ec9e6-a8a2-4576-bc65-af255b2594e6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.749887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da1ec9e6-a8a2-4576-bc65-af255b2594e6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.750309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da1ec9e6-a8a2-4576-bc65-af255b2594e6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.780748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-da1ec9e6-a8a2-4576-bc65-af255b2594e6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Aug 29 22:51:36.781313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 627/1251] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:37.365377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b5218efd-7c76-4b2d-bcc0-8042a6679efc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:37.367418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b5218efd-7c76-4b2d-bcc0-8042a6679efc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:37.374685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5218efd-7c76-4b2d-bcc0-8042a6679efc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.375169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5218efd-7c76-4b2d-bcc0-8042a6679efc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.375605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5218efd-7c76-4b2d-bcc0-8042a6679efc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.376335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5218efd-7c76-4b2d-bcc0-8042a6679efc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.376806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5218efd-7c76-4b2d-bcc0-8042a6679efc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.377205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5218efd-7c76-4b2d-bcc0-8042a6679efc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.407742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b5218efd-7c76-4b2d-bcc0-8042a6679efc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046388 Aug 29 22:51:37.408332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 625/1252] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:37.523574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:37.524217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:37.530491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.530974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.531408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.532159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.532616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.533042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.575135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2df369a5-dc08-452f-9a8e-6d3f9298220c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:37.577415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2df369a5-dc08-452f-9a8e-6d3f9298220c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:37.584842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df369a5-dc08-452f-9a8e-6d3f9298220c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.585569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df369a5-dc08-452f-9a8e-6d3f9298220c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.586008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df369a5-dc08-452f-9a8e-6d3f9298220c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.586713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df369a5-dc08-452f-9a8e-6d3f9298220c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.587166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df369a5-dc08-452f-9a8e-6d3f9298220c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.587614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df369a5-dc08-452f-9a8e-6d3f9298220c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.597553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:37.605953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3012b6c5-40b0-4fc2-81ee-be6cf28806ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086751 Aug 29 22:51:37.606526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 628/1253] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:37 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:37.620051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2df369a5-dc08-452f-9a8e-6d3f9298220c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048973 Aug 29 22:51:37.620652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 626/1254] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:37.793684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d52d8328-2c08-4844-aae4-15218a71d548 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:37.795834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d52d8328-2c08-4844-aae4-15218a71d548 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:37.803272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d52d8328-2c08-4844-aae4-15218a71d548 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.803768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d52d8328-2c08-4844-aae4-15218a71d548 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.804238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d52d8328-2c08-4844-aae4-15218a71d548 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.804955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d52d8328-2c08-4844-aae4-15218a71d548 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.805414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d52d8328-2c08-4844-aae4-15218a71d548 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.805837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d52d8328-2c08-4844-aae4-15218a71d548 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.838429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d52d8328-2c08-4844-aae4-15218a71d548 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049122 Aug 29 22:51:37.839002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 629/1255] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:38.421115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d2410c87-e760-4178-b565-3baecf41d623 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:38.423501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d2410c87-e760-4178-b565-3baecf41d623 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:38.431193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2410c87-e760-4178-b565-3baecf41d623 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.431670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2410c87-e760-4178-b565-3baecf41d623 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.432101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2410c87-e760-4178-b565-3baecf41d623 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.432823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2410c87-e760-4178-b565-3baecf41d623 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.433266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2410c87-e760-4178-b565-3baecf41d623 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.433680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2410c87-e760-4178-b565-3baecf41d623 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.463536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d2410c87-e760-4178-b565-3baecf41d623 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046304 Aug 29 22:51:38.476818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 627/1256] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:38.626233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:38.626838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:38.632724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-caf21220-afd8-401a-afd9-958dfcc71325 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:38.633417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.634190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.634352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.635011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.635321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-caf21220-afd8-401a-afd9-958dfcc71325 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:38.635441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.635862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.642487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-caf21220-afd8-401a-afd9-958dfcc71325 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.642975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-caf21220-afd8-401a-afd9-958dfcc71325 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.643418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-caf21220-afd8-401a-afd9-958dfcc71325 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.644188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-caf21220-afd8-401a-afd9-958dfcc71325 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.644668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-caf21220-afd8-401a-afd9-958dfcc71325 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.645096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-caf21220-afd8-401a-afd9-958dfcc71325 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.677666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-caf21220-afd8-401a-afd9-958dfcc71325 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048763 Aug 29 22:51:38.678404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 628/1257] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:38.705522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:38.714868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e76444e2-8aa8-47e5-88b6-46b59ea0e9d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092412 Aug 29 22:51:38.715453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 630/1258] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:38 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:38.852674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-90017fc9-6d7a-43de-b128-94d4224f8ec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:38.854984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-90017fc9-6d7a-43de-b128-94d4224f8ec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:38.861274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90017fc9-6d7a-43de-b128-94d4224f8ec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.861964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90017fc9-6d7a-43de-b128-94d4224f8ec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.862495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90017fc9-6d7a-43de-b128-94d4224f8ec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.863277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90017fc9-6d7a-43de-b128-94d4224f8ec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.863969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90017fc9-6d7a-43de-b128-94d4224f8ec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.864630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90017fc9-6d7a-43de-b128-94d4224f8ec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.898133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-90017fc9-6d7a-43de-b128-94d4224f8ec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050197 Aug 29 22:51:38.898133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 629/1259] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:39.476223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a9efb8db-45a8-4d62-a4d9-e8972d7885ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:39.478388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a9efb8db-45a8-4d62-a4d9-e8972d7885ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:39.485076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9efb8db-45a8-4d62-a4d9-e8972d7885ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.485583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9efb8db-45a8-4d62-a4d9-e8972d7885ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.486025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9efb8db-45a8-4d62-a4d9-e8972d7885ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.486730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9efb8db-45a8-4d62-a4d9-e8972d7885ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.487182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9efb8db-45a8-4d62-a4d9-e8972d7885ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.487609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9efb8db-45a8-4d62-a4d9-e8972d7885ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.517991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a9efb8db-45a8-4d62-a4d9-e8972d7885ff tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046560 Aug 29 22:51:39.518556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 631/1260] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:39.690161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-64448ffc-215c-4976-824d-928cb6f477b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:39.692527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-64448ffc-215c-4976-824d-928cb6f477b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:39.700917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64448ffc-215c-4976-824d-928cb6f477b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.704073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64448ffc-215c-4976-824d-928cb6f477b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.704073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64448ffc-215c-4976-824d-928cb6f477b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.704073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64448ffc-215c-4976-824d-928cb6f477b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.704073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64448ffc-215c-4976-824d-928cb6f477b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.704589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64448ffc-215c-4976-824d-928cb6f477b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.738076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:39.738780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:39.743908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-64448ffc-215c-4976-824d-928cb6f477b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057796 Aug 29 22:51:39.744538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 630/1261] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:39.745872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.746385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.746958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.747542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.748000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.748465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.811968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:39.821134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9902a494-19f4-4eb1-afad-71f78cd80f04 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086974 Aug 29 22:51:39.821704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 632/1262] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:39 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:39.909990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-83330045-0689-4894-8163-9d1e1d1e7246 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:39.912231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-83330045-0689-4894-8163-9d1e1d1e7246 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:39.918865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83330045-0689-4894-8163-9d1e1d1e7246 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.919358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83330045-0689-4894-8163-9d1e1d1e7246 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.919799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83330045-0689-4894-8163-9d1e1d1e7246 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.920562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83330045-0689-4894-8163-9d1e1d1e7246 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.921057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83330045-0689-4894-8163-9d1e1d1e7246 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.921429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83330045-0689-4894-8163-9d1e1d1e7246 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.953568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-83330045-0689-4894-8163-9d1e1d1e7246 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047600 Aug 29 22:51:39.954145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 631/1263] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:40.531143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0c9ce060-bb31-46e2-8708-9e75e2bedc3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:40.533414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0c9ce060-bb31-46e2-8708-9e75e2bedc3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:40.540989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c9ce060-bb31-46e2-8708-9e75e2bedc3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.541470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c9ce060-bb31-46e2-8708-9e75e2bedc3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.541905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c9ce060-bb31-46e2-8708-9e75e2bedc3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.542602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c9ce060-bb31-46e2-8708-9e75e2bedc3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.543062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c9ce060-bb31-46e2-8708-9e75e2bedc3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.543484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c9ce060-bb31-46e2-8708-9e75e2bedc3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.575320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0c9ce060-bb31-46e2-8708-9e75e2bedc3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048172 Aug 29 22:51:40.575891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 633/1264] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:40.757013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac2c1c80-ed2e-41ac-a209-cd0cf9e6510d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:40.759221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac2c1c80-ed2e-41ac-a209-cd0cf9e6510d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:40.765853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac2c1c80-ed2e-41ac-a209-cd0cf9e6510d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.766326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac2c1c80-ed2e-41ac-a209-cd0cf9e6510d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.766760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac2c1c80-ed2e-41ac-a209-cd0cf9e6510d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.767485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac2c1c80-ed2e-41ac-a209-cd0cf9e6510d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.767939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac2c1c80-ed2e-41ac-a209-cd0cf9e6510d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.768400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac2c1c80-ed2e-41ac-a209-cd0cf9e6510d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.788059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:40.800696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac2c1c80-ed2e-41ac-a209-cd0cf9e6510d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048135 Aug 29 22:51:40.801471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 632/1265] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:40 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:40.842980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:40.843568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:40.850153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.850645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.851173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.851921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.852411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.852841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.918195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:40.929733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-119c89d2-63a9-4cf6-b66b-fbcd00ab4244 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090569 Aug 29 22:51:40.930479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 634/1266] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:40 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:40.967216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6cce9b4c-3ebb-4363-a514-5179845cf620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:40.969554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6cce9b4c-3ebb-4363-a514-5179845cf620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:40.978786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cce9b4c-3ebb-4363-a514-5179845cf620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.979739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cce9b4c-3ebb-4363-a514-5179845cf620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.980738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cce9b4c-3ebb-4363-a514-5179845cf620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.981596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cce9b4c-3ebb-4363-a514-5179845cf620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.982376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cce9b4c-3ebb-4363-a514-5179845cf620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.983104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cce9b4c-3ebb-4363-a514-5179845cf620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.018119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6cce9b4c-3ebb-4363-a514-5179845cf620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054873 Aug 29 22:51:41.018701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 633/1267] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:41.588595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3cbad8e6-2fd0-40ab-8c57-98f00f11fabc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:41.590788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3cbad8e6-2fd0-40ab-8c57-98f00f11fabc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:41.597343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cbad8e6-2fd0-40ab-8c57-98f00f11fabc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.598371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cbad8e6-2fd0-40ab-8c57-98f00f11fabc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.598816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cbad8e6-2fd0-40ab-8c57-98f00f11fabc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.599600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cbad8e6-2fd0-40ab-8c57-98f00f11fabc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.600050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cbad8e6-2fd0-40ab-8c57-98f00f11fabc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.600508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3cbad8e6-2fd0-40ab-8c57-98f00f11fabc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.633130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3cbad8e6-2fd0-40ab-8c57-98f00f11fabc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048554 Aug 29 22:51:41.633712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 635/1268] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:41.813936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bb395b4b-9978-4175-afaf-0fbe768cfe13 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:41.816211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bb395b4b-9978-4175-afaf-0fbe768cfe13 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:41.823583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb395b4b-9978-4175-afaf-0fbe768cfe13 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.824079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb395b4b-9978-4175-afaf-0fbe768cfe13 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.824550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb395b4b-9978-4175-afaf-0fbe768cfe13 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.825313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb395b4b-9978-4175-afaf-0fbe768cfe13 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.825767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb395b4b-9978-4175-afaf-0fbe768cfe13 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.826193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb395b4b-9978-4175-afaf-0fbe768cfe13 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.862959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bb395b4b-9978-4175-afaf-0fbe768cfe13 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052935 Aug 29 22:51:41.863622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 634/1269] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:41.951424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:41.952039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:41.959345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.959831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.960367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.961270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.961724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.962145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.025874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:42.030378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0dfcf630-34cc-43ab-81be-b9adf0975620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:42.032578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0dfcf630-34cc-43ab-81be-b9adf0975620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:42.035968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-12d7694c-adb7-445e-9b67-f7878488431a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087188 Aug 29 22:51:42.036322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 636/1270] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:41 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:42.040580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dfcf630-34cc-43ab-81be-b9adf0975620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.040991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dfcf630-34cc-43ab-81be-b9adf0975620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.041623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dfcf630-34cc-43ab-81be-b9adf0975620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.042377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dfcf630-34cc-43ab-81be-b9adf0975620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.042853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dfcf630-34cc-43ab-81be-b9adf0975620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.043290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dfcf630-34cc-43ab-81be-b9adf0975620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.074420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0dfcf630-34cc-43ab-81be-b9adf0975620 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048220 Aug 29 22:51:42.075002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 635/1271] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:42.646485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7ef2705e-4838-4f15-ba1c-038e1252c5a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:42.648789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7ef2705e-4838-4f15-ba1c-038e1252c5a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:42.655395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ef2705e-4838-4f15-ba1c-038e1252c5a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.655858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ef2705e-4838-4f15-ba1c-038e1252c5a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.656351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ef2705e-4838-4f15-ba1c-038e1252c5a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.657057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ef2705e-4838-4f15-ba1c-038e1252c5a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.657515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ef2705e-4838-4f15-ba1c-038e1252c5a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.657942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ef2705e-4838-4f15-ba1c-038e1252c5a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.684278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:42.688918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7ef2705e-4838-4f15-ba1c-038e1252c5a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047327 Aug 29 22:51:42.689493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 637/1272] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:42.875261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7cb2b491-4891-4f4d-9cba-c1ead3093164 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:42.877484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7cb2b491-4891-4f4d-9cba-c1ead3093164 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:42.885442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cb2b491-4891-4f4d-9cba-c1ead3093164 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.885938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cb2b491-4891-4f4d-9cba-c1ead3093164 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.886386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cb2b491-4891-4f4d-9cba-c1ead3093164 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.887108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cb2b491-4891-4f4d-9cba-c1ead3093164 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.887568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cb2b491-4891-4f4d-9cba-c1ead3093164 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.888003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7cb2b491-4891-4f4d-9cba-c1ead3093164 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.922149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7cb2b491-4891-4f4d-9cba-c1ead3093164 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050870 Aug 29 22:51:42.922828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 636/1273] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:43.056492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:43.057247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:43.063746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.064268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.064705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.065431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.065883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.066309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.087119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8f856bb0-aa42-488a-afc3-a4bce9bbf46c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:43.089341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8f856bb0-aa42-488a-afc3-a4bce9bbf46c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:43.097778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f856bb0-aa42-488a-afc3-a4bce9bbf46c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.097778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f856bb0-aa42-488a-afc3-a4bce9bbf46c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.097778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f856bb0-aa42-488a-afc3-a4bce9bbf46c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.098517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f856bb0-aa42-488a-afc3-a4bce9bbf46c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.099239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f856bb0-aa42-488a-afc3-a4bce9bbf46c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.099762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f856bb0-aa42-488a-afc3-a4bce9bbf46c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.132946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8f856bb0-aa42-488a-afc3-a4bce9bbf46c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049739 Aug 29 22:51:43.133529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 637/1274] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:43.137213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:43.145820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-202a1ae9-af29-4f1f-b3e0-df261b0af9e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093246 Aug 29 22:51:43.146388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 638/1275] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:43 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:43.702012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5997597d-22f8-4656-bb87-d3fdfbb99158 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:43.704111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5997597d-22f8-4656-bb87-d3fdfbb99158 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:43.710864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5997597d-22f8-4656-bb87-d3fdfbb99158 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.711351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5997597d-22f8-4656-bb87-d3fdfbb99158 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.711785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5997597d-22f8-4656-bb87-d3fdfbb99158 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.712514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5997597d-22f8-4656-bb87-d3fdfbb99158 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.712971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5997597d-22f8-4656-bb87-d3fdfbb99158 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.713384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5997597d-22f8-4656-bb87-d3fdfbb99158 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.745174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5997597d-22f8-4656-bb87-d3fdfbb99158 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047216 Aug 29 22:51:43.745749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 638/1276] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:43.935242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f07be957-7665-4939-a270-af126035c21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:43.937496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f07be957-7665-4939-a270-af126035c21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:43.944257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f07be957-7665-4939-a270-af126035c21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.944742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f07be957-7665-4939-a270-af126035c21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.945176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f07be957-7665-4939-a270-af126035c21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.945930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f07be957-7665-4939-a270-af126035c21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.946383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f07be957-7665-4939-a270-af126035c21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.946818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f07be957-7665-4939-a270-af126035c21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.979465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f07be957-7665-4939-a270-af126035c21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048217 Aug 29 22:51:43.979978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 639/1277] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:44.146320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-90bb4b67-8a92-4abc-b984-c80412a40d5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:44.148504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-90bb4b67-8a92-4abc-b984-c80412a40d5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:44.154959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90bb4b67-8a92-4abc-b984-c80412a40d5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.155463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90bb4b67-8a92-4abc-b984-c80412a40d5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.155884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90bb4b67-8a92-4abc-b984-c80412a40d5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.156601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90bb4b67-8a92-4abc-b984-c80412a40d5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.157055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90bb4b67-8a92-4abc-b984-c80412a40d5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.157583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90bb4b67-8a92-4abc-b984-c80412a40d5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.166942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:44.167556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:44.173583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.174049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.174502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.175187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.175644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.176352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.188869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-90bb4b67-8a92-4abc-b984-c80412a40d5f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047385 Aug 29 22:51:44.189452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 639/1278] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:44.239932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:44.247950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e23595b9-03f4-455d-b8f4-17b4a48121fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084806 Aug 29 22:51:44.248568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 640/1279] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:44 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:44.759870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3ed3df54-b77a-455c-a3c2-53e5ac3b3980 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:44.762213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3ed3df54-b77a-455c-a3c2-53e5ac3b3980 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:44.769330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ed3df54-b77a-455c-a3c2-53e5ac3b3980 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.770485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ed3df54-b77a-455c-a3c2-53e5ac3b3980 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.771362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ed3df54-b77a-455c-a3c2-53e5ac3b3980 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.772328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ed3df54-b77a-455c-a3c2-53e5ac3b3980 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.772969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ed3df54-b77a-455c-a3c2-53e5ac3b3980 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.773433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ed3df54-b77a-455c-a3c2-53e5ac3b3980 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.811089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3ed3df54-b77a-455c-a3c2-53e5ac3b3980 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056549 Aug 29 22:51:44.811681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 640/1280] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:44.993377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6bd521f4-abea-4092-b2b5-910169a17701 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:44.995605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6bd521f4-abea-4092-b2b5-910169a17701 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:45.002567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bd521f4-abea-4092-b2b5-910169a17701 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.003051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bd521f4-abea-4092-b2b5-910169a17701 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.003493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bd521f4-abea-4092-b2b5-910169a17701 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.004293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bd521f4-abea-4092-b2b5-910169a17701 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.004734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bd521f4-abea-4092-b2b5-910169a17701 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.005165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bd521f4-abea-4092-b2b5-910169a17701 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.041055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6bd521f4-abea-4092-b2b5-910169a17701 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052351 Aug 29 22:51:45.041729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 641/1281] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:45.202516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-268ba01e-bbe6-4d9b-a0c4-427b601adef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:45.204741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-268ba01e-bbe6-4d9b-a0c4-427b601adef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:45.212651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-268ba01e-bbe6-4d9b-a0c4-427b601adef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.213140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-268ba01e-bbe6-4d9b-a0c4-427b601adef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.213600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-268ba01e-bbe6-4d9b-a0c4-427b601adef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.214356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-268ba01e-bbe6-4d9b-a0c4-427b601adef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.214754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-268ba01e-bbe6-4d9b-a0c4-427b601adef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.215181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-268ba01e-bbe6-4d9b-a0c4-427b601adef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.245006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-268ba01e-bbe6-4d9b-a0c4-427b601adef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046463 Aug 29 22:51:45.245574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 641/1282] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:45.269294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:45.270542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:45.276622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.277111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.277550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.278257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.278725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.279153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.373750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:45.388766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3bb9dd73-c849-4182-867f-8e88ec25fd78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.123308 Aug 29 22:51:45.389361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 642/1283] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:45 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:45.824060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eb5ed6ed-1218-4c72-9260-5b448d743ce5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:45.826235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eb5ed6ed-1218-4c72-9260-5b448d743ce5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:45.833607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb5ed6ed-1218-4c72-9260-5b448d743ce5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.834098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb5ed6ed-1218-4c72-9260-5b448d743ce5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.834528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb5ed6ed-1218-4c72-9260-5b448d743ce5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.835223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb5ed6ed-1218-4c72-9260-5b448d743ce5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.835672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb5ed6ed-1218-4c72-9260-5b448d743ce5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.836093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb5ed6ed-1218-4c72-9260-5b448d743ce5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.867245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eb5ed6ed-1218-4c72-9260-5b448d743ce5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047145 Aug 29 22:51:45.867807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 642/1284] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:46.053637 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6d2013c7-382e-4465-acee-f4ccbe653397 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:46.055828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6d2013c7-382e-4465-acee-f4ccbe653397 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:46.062634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d2013c7-382e-4465-acee-f4ccbe653397 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:46.063120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d2013c7-382e-4465-acee-f4ccbe653397 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:46.063559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d2013c7-382e-4465-acee-f4ccbe653397 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.064408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d2013c7-382e-4465-acee-f4ccbe653397 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:46.065097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d2013c7-382e-4465-acee-f4ccbe653397 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:46.065591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d2013c7-382e-4465-acee-f4ccbe653397 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.098247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6d2013c7-382e-4465-acee-f4ccbe653397 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048813 Aug 29 22:51:46.099021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 643/1285] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:46.258236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-da013408-f58a-4d93-a178-88183bd38e91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:46.260428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-da013408-f58a-4d93-a178-88183bd38e91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:46.266926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da013408-f58a-4d93-a178-88183bd38e91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:46.267411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da013408-f58a-4d93-a178-88183bd38e91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:46.267845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da013408-f58a-4d93-a178-88183bd38e91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.268579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da013408-f58a-4d93-a178-88183bd38e91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:46.269036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da013408-f58a-4d93-a178-88183bd38e91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:46.269488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da013408-f58a-4d93-a178-88183bd38e91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.300933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-da013408-f58a-4d93-a178-88183bd38e91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047338 Aug 29 22:51:46.301502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 643/1286] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:46 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:46.411343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:46.412300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:46.418447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:46.418925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:46.419359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.420054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:46.420533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:46.420957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.487643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:46.496831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e3ad095c-e7c1-4902-832d-2d815a5bcfdc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089918 Aug 29 22:51:46.497493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 644/1287] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:46 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:46.880520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-97671b5a-8dec-45ee-81f1-313a31cac758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:46.882668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-97671b5a-8dec-45ee-81f1-313a31cac758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:46.888815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97671b5a-8dec-45ee-81f1-313a31cac758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:46.889293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97671b5a-8dec-45ee-81f1-313a31cac758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:46.889721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97671b5a-8dec-45ee-81f1-313a31cac758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.890416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97671b5a-8dec-45ee-81f1-313a31cac758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:46.890867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97671b5a-8dec-45ee-81f1-313a31cac758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:46.891286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97671b5a-8dec-45ee-81f1-313a31cac758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.922073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-97671b5a-8dec-45ee-81f1-313a31cac758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046250 Aug 29 22:51:46.922665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 644/1288] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:47.111282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-667c29bd-fd9e-4333-9ef6-df4c2c1bb38f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:47.114151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-667c29bd-fd9e-4333-9ef6-df4c2c1bb38f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:47.121966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-667c29bd-fd9e-4333-9ef6-df4c2c1bb38f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.122662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-667c29bd-fd9e-4333-9ef6-df4c2c1bb38f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.123279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-667c29bd-fd9e-4333-9ef6-df4c2c1bb38f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.124158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-667c29bd-fd9e-4333-9ef6-df4c2c1bb38f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.124882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-667c29bd-fd9e-4333-9ef6-df4c2c1bb38f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.125394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-667c29bd-fd9e-4333-9ef6-df4c2c1bb38f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.158515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-667c29bd-fd9e-4333-9ef6-df4c2c1bb38f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051198 Aug 29 22:51:47.159010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 645/1289] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:47.314452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0faed2e0-52e7-4bb0-a993-d6161bc7e6b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:47.316667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0faed2e0-52e7-4bb0-a993-d6161bc7e6b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:47.323556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0faed2e0-52e7-4bb0-a993-d6161bc7e6b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.324041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0faed2e0-52e7-4bb0-a993-d6161bc7e6b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.324582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0faed2e0-52e7-4bb0-a993-d6161bc7e6b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.325293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0faed2e0-52e7-4bb0-a993-d6161bc7e6b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.325783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0faed2e0-52e7-4bb0-a993-d6161bc7e6b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.326208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0faed2e0-52e7-4bb0-a993-d6161bc7e6b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.362542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0faed2e0-52e7-4bb0-a993-d6161bc7e6b6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052442 Aug 29 22:51:47.363124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 645/1290] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:47.521099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:47.521675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:47.528071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.528606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.529050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.529776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.530238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.530666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.601596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:47.609704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-79ae791a-325e-4764-99ca-75c3322975cd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093051 Aug 29 22:51:47.610283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 646/1291] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:47 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:47.935502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1f2544c0-33fc-4f24-9339-ba3590bb5f6b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:47.937657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1f2544c0-33fc-4f24-9339-ba3590bb5f6b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:47.944974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f2544c0-33fc-4f24-9339-ba3590bb5f6b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.945464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f2544c0-33fc-4f24-9339-ba3590bb5f6b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.945892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f2544c0-33fc-4f24-9339-ba3590bb5f6b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.946594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f2544c0-33fc-4f24-9339-ba3590bb5f6b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.947049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f2544c0-33fc-4f24-9339-ba3590bb5f6b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.947466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f2544c0-33fc-4f24-9339-ba3590bb5f6b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.979392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1f2544c0-33fc-4f24-9339-ba3590bb5f6b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047962 Aug 29 22:51:47.979964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 646/1292] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:48.171125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ad392379-1651-4325-8961-6103aa923037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:48.173412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ad392379-1651-4325-8961-6103aa923037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:48.180631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad392379-1651-4325-8961-6103aa923037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.181109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad392379-1651-4325-8961-6103aa923037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.181540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad392379-1651-4325-8961-6103aa923037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.182225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad392379-1651-4325-8961-6103aa923037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.182669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad392379-1651-4325-8961-6103aa923037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.183085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad392379-1651-4325-8961-6103aa923037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.214000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ad392379-1651-4325-8961-6103aa923037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046977 Aug 29 22:51:48.214573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 647/1293] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:48.379404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0527814d-cf09-459f-8d71-c96a3feaf25e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:48.381772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0527814d-cf09-459f-8d71-c96a3feaf25e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:48.388131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0527814d-cf09-459f-8d71-c96a3feaf25e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.388736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0527814d-cf09-459f-8d71-c96a3feaf25e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.389261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0527814d-cf09-459f-8d71-c96a3feaf25e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.390055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0527814d-cf09-459f-8d71-c96a3feaf25e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.390519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0527814d-cf09-459f-8d71-c96a3feaf25e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.390924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0527814d-cf09-459f-8d71-c96a3feaf25e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.423014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0527814d-cf09-459f-8d71-c96a3feaf25e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047944 Aug 29 22:51:48.423519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 647/1294] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:48.632572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:48.633213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:48.639194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.639677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.640110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.640831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.641668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.642399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.713950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:48.721736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2ad0a988-f13d-41f8-9fd9-36e38e7ce5e7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094141 Aug 29 22:51:48.722310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 648/1295] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:48 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:48.994073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2a2844aa-eda9-4afa-a91e-babd6b39dfa0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:48.996734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2a2844aa-eda9-4afa-a91e-babd6b39dfa0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:49.003620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a2844aa-eda9-4afa-a91e-babd6b39dfa0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.007857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a2844aa-eda9-4afa-a91e-babd6b39dfa0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.007857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a2844aa-eda9-4afa-a91e-babd6b39dfa0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.007857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a2844aa-eda9-4afa-a91e-babd6b39dfa0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.007857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a2844aa-eda9-4afa-a91e-babd6b39dfa0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.008517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a2844aa-eda9-4afa-a91e-babd6b39dfa0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.044118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2a2844aa-eda9-4afa-a91e-babd6b39dfa0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056011 Aug 29 22:51:49.044732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 648/1296] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:49.227838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-90f8b015-95e1-42a8-b735-d94030b4812f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:49.230018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-90f8b015-95e1-42a8-b735-d94030b4812f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:49.236771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90f8b015-95e1-42a8-b735-d94030b4812f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.237253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90f8b015-95e1-42a8-b735-d94030b4812f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.237684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90f8b015-95e1-42a8-b735-d94030b4812f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.238380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90f8b015-95e1-42a8-b735-d94030b4812f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.239056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90f8b015-95e1-42a8-b735-d94030b4812f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.239800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-90f8b015-95e1-42a8-b735-d94030b4812f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.278294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-90f8b015-95e1-42a8-b735-d94030b4812f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055117 Aug 29 22:51:49.278785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 649/1297] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:49.437221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b551bdd1-20c6-4867-be79-b8ef527adfba tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:49.439399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b551bdd1-20c6-4867-be79-b8ef527adfba tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:49.446362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b551bdd1-20c6-4867-be79-b8ef527adfba tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.446856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b551bdd1-20c6-4867-be79-b8ef527adfba tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.447294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b551bdd1-20c6-4867-be79-b8ef527adfba tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.448002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b551bdd1-20c6-4867-be79-b8ef527adfba tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.448494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b551bdd1-20c6-4867-be79-b8ef527adfba tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.448913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b551bdd1-20c6-4867-be79-b8ef527adfba tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.453122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:49.483705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b551bdd1-20c6-4867-be79-b8ef527adfba tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050948 Aug 29 22:51:49.484308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 649/1298] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:49 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:49.743558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:49.744191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:49.750333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.751259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.752054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.754836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.755615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.756521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.822150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:49.829829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-530507ff-33ea-4fd6-a2de-bbc9ce298d54 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091020 Aug 29 22:51:49.830679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 650/1299] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:49 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:50.058025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2fe54549-ff73-435c-a05e-8e07465dc65d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:50.060235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2fe54549-ff73-435c-a05e-8e07465dc65d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:50.066912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe54549-ff73-435c-a05e-8e07465dc65d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.067394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe54549-ff73-435c-a05e-8e07465dc65d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.067826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe54549-ff73-435c-a05e-8e07465dc65d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.068545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe54549-ff73-435c-a05e-8e07465dc65d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.068990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe54549-ff73-435c-a05e-8e07465dc65d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.069407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fe54549-ff73-435c-a05e-8e07465dc65d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.105141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2fe54549-ff73-435c-a05e-8e07465dc65d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051251 Aug 29 22:51:50.105800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 650/1300] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:50.291817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8b423ce6-2339-400c-98b5-1cfbc70d67fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:50.294121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8b423ce6-2339-400c-98b5-1cfbc70d67fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:50.300989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b423ce6-2339-400c-98b5-1cfbc70d67fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.301477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b423ce6-2339-400c-98b5-1cfbc70d67fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.301913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b423ce6-2339-400c-98b5-1cfbc70d67fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.302801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b423ce6-2339-400c-98b5-1cfbc70d67fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.303280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b423ce6-2339-400c-98b5-1cfbc70d67fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.303698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b423ce6-2339-400c-98b5-1cfbc70d67fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.336989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8b423ce6-2339-400c-98b5-1cfbc70d67fe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049125 Aug 29 22:51:50.337480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 651/1301] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:50.496943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-78b360e9-64ba-4366-a34f-cd3eefb64dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:50.499219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-78b360e9-64ba-4366-a34f-cd3eefb64dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:50.506380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78b360e9-64ba-4366-a34f-cd3eefb64dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.506869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78b360e9-64ba-4366-a34f-cd3eefb64dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.507349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78b360e9-64ba-4366-a34f-cd3eefb64dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.508092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78b360e9-64ba-4366-a34f-cd3eefb64dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.508646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78b360e9-64ba-4366-a34f-cd3eefb64dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.509075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78b360e9-64ba-4366-a34f-cd3eefb64dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.542995 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-78b360e9-64ba-4366-a34f-cd3eefb64dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050150 Aug 29 22:51:50.543587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 651/1302] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:50.851853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:50.852525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:50.858882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.863034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.863034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.863034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.863034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.864102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.926417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:50.935817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c2bd06ac-6c81-4f44-b27e-f535e39e0227 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088299 Aug 29 22:51:50.936699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 652/1303] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:50 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:51.118773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-04be32fb-1fb0-4e28-9f63-a54afa610a2d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:51.120936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-04be32fb-1fb0-4e28-9f63-a54afa610a2d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:51.126919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04be32fb-1fb0-4e28-9f63-a54afa610a2d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.127392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04be32fb-1fb0-4e28-9f63-a54afa610a2d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.127821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04be32fb-1fb0-4e28-9f63-a54afa610a2d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.128551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04be32fb-1fb0-4e28-9f63-a54afa610a2d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.129375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04be32fb-1fb0-4e28-9f63-a54afa610a2d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.129885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04be32fb-1fb0-4e28-9f63-a54afa610a2d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.159877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-04be32fb-1fb0-4e28-9f63-a54afa610a2d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045132 Aug 29 22:51:51.161262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 652/1304] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:51.350070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3070b5b7-2988-4b7c-83bc-07d68848d279 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:51.352408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3070b5b7-2988-4b7c-83bc-07d68848d279 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:51.359148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3070b5b7-2988-4b7c-83bc-07d68848d279 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.359658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3070b5b7-2988-4b7c-83bc-07d68848d279 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.360077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3070b5b7-2988-4b7c-83bc-07d68848d279 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.360816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3070b5b7-2988-4b7c-83bc-07d68848d279 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.361274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3070b5b7-2988-4b7c-83bc-07d68848d279 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.361702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3070b5b7-2988-4b7c-83bc-07d68848d279 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.397391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3070b5b7-2988-4b7c-83bc-07d68848d279 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050862 Aug 29 22:51:51.397391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 653/1305] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:51.556044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5dba1750-014f-4c27-bd37-3896249c65d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:51.558279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5dba1750-014f-4c27-bd37-3896249c65d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:51.564803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5dba1750-014f-4c27-bd37-3896249c65d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.565286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5dba1750-014f-4c27-bd37-3896249c65d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.565715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5dba1750-014f-4c27-bd37-3896249c65d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.566734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5dba1750-014f-4c27-bd37-3896249c65d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.567342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5dba1750-014f-4c27-bd37-3896249c65d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.567780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5dba1750-014f-4c27-bd37-3896249c65d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.600405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5dba1750-014f-4c27-bd37-3896249c65d9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048513 Aug 29 22:51:51.601004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 653/1306] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:51.958782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:51.959408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:51.965815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.966293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.966730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.967429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.967889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.968347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.984068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:52.033910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:52.042248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c61a8e3b-8803-48c7-ba21-0d2a72ef84a8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088732 Aug 29 22:51:52.042826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 654/1307] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:51 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:52.173943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-801e2182-dc90-4aa6-9faa-7fddf74f7ac4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:52.176613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-801e2182-dc90-4aa6-9faa-7fddf74f7ac4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:52.182984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-801e2182-dc90-4aa6-9faa-7fddf74f7ac4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:52.183635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-801e2182-dc90-4aa6-9faa-7fddf74f7ac4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:52.184073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-801e2182-dc90-4aa6-9faa-7fddf74f7ac4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:52.184856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-801e2182-dc90-4aa6-9faa-7fddf74f7ac4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:52.185316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-801e2182-dc90-4aa6-9faa-7fddf74f7ac4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:52.185742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-801e2182-dc90-4aa6-9faa-7fddf74f7ac4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:52.217470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-801e2182-dc90-4aa6-9faa-7fddf74f7ac4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047841 Aug 29 22:51:52.218033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 654/1308] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:52.409808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1945d363-de97-43f1-9475-11014fe1a065 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:52.412094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1945d363-de97-43f1-9475-11014fe1a065 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:52.419041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1945d363-de97-43f1-9475-11014fe1a065 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:52.419584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1945d363-de97-43f1-9475-11014fe1a065 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:52.420028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1945d363-de97-43f1-9475-11014fe1a065 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:52.420756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1945d363-de97-43f1-9475-11014fe1a065 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:52.421214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1945d363-de97-43f1-9475-11014fe1a065 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:52.421680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1945d363-de97-43f1-9475-11014fe1a065 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:52.456699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1945d363-de97-43f1-9475-11014fe1a065 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051049 Aug 29 22:51:52.457336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 655/1309] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:52.612950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5d13be82-1777-4f8c-9ffe-a2ee463cd8e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:52.615234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5d13be82-1777-4f8c-9ffe-a2ee463cd8e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:52.621367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d13be82-1777-4f8c-9ffe-a2ee463cd8e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:52.621842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d13be82-1777-4f8c-9ffe-a2ee463cd8e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:52.622272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d13be82-1777-4f8c-9ffe-a2ee463cd8e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:52.623016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d13be82-1777-4f8c-9ffe-a2ee463cd8e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:52.623460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d13be82-1777-4f8c-9ffe-a2ee463cd8e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:52.623877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d13be82-1777-4f8c-9ffe-a2ee463cd8e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:52.660852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5d13be82-1777-4f8c-9ffe-a2ee463cd8e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051383 Aug 29 22:51:52.662024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 655/1310] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:53.063191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:53.063815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:53.070370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.070854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.071284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.071977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.072454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.072896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.137359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:53.145840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3ea2f785-6d88-436d-9276-568f7f6c1bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086476 Aug 29 22:51:53.146421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 656/1311] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:53 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:53.230777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-03fd33bf-d736-49fc-a9b0-0004d4bf8f20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:53.232946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-03fd33bf-d736-49fc-a9b0-0004d4bf8f20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:53.240324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03fd33bf-d736-49fc-a9b0-0004d4bf8f20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.240800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03fd33bf-d736-49fc-a9b0-0004d4bf8f20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.241251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03fd33bf-d736-49fc-a9b0-0004d4bf8f20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.241974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03fd33bf-d736-49fc-a9b0-0004d4bf8f20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.242432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03fd33bf-d736-49fc-a9b0-0004d4bf8f20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.242861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03fd33bf-d736-49fc-a9b0-0004d4bf8f20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.277289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-03fd33bf-d736-49fc-a9b0-0004d4bf8f20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050689 Aug 29 22:51:53.277888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 656/1312] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:53.478458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a9dd55bf-181d-42ed-adbd-65af096a7ac4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:53.480775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a9dd55bf-181d-42ed-adbd-65af096a7ac4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:53.486963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9dd55bf-181d-42ed-adbd-65af096a7ac4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.487372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9dd55bf-181d-42ed-adbd-65af096a7ac4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.487803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9dd55bf-181d-42ed-adbd-65af096a7ac4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.488952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9dd55bf-181d-42ed-adbd-65af096a7ac4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.489515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9dd55bf-181d-42ed-adbd-65af096a7ac4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.489976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a9dd55bf-181d-42ed-adbd-65af096a7ac4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.525223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a9dd55bf-181d-42ed-adbd-65af096a7ac4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050846 Aug 29 22:51:53.525804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 657/1313] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:53 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:53.674476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82406c55-fe63-438d-ab41-8b50b70796f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:53.677184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82406c55-fe63-438d-ab41-8b50b70796f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:53.683507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82406c55-fe63-438d-ab41-8b50b70796f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.683985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82406c55-fe63-438d-ab41-8b50b70796f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.684440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82406c55-fe63-438d-ab41-8b50b70796f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.685137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82406c55-fe63-438d-ab41-8b50b70796f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.685582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82406c55-fe63-438d-ab41-8b50b70796f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.685999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82406c55-fe63-438d-ab41-8b50b70796f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.719340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82406c55-fe63-438d-ab41-8b50b70796f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048806 Aug 29 22:51:53.719899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 657/1314] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:54.166871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:54.167460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:54.173872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.174345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.174773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.175451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.176638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.177066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.239937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:54.248040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b385067e-241f-4e91-927a-9bf57c7dd334 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084970 Aug 29 22:51:54.248645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 658/1315] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:54 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:54.290608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9b025b17-825e-4e85-a29a-79771475c593 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:54.292769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9b025b17-825e-4e85-a29a-79771475c593 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:54.299183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b025b17-825e-4e85-a29a-79771475c593 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.299667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b025b17-825e-4e85-a29a-79771475c593 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.300107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b025b17-825e-4e85-a29a-79771475c593 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.301696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b025b17-825e-4e85-a29a-79771475c593 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.302278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b025b17-825e-4e85-a29a-79771475c593 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.302691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b025b17-825e-4e85-a29a-79771475c593 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.335024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9b025b17-825e-4e85-a29a-79771475c593 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048362 Aug 29 22:51:54.335624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 658/1316] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:54.537643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-abafa822-8c16-44f8-97be-2dc8ab6feed6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:54.539717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-abafa822-8c16-44f8-97be-2dc8ab6feed6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:54.545882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abafa822-8c16-44f8-97be-2dc8ab6feed6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.546370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abafa822-8c16-44f8-97be-2dc8ab6feed6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.546814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abafa822-8c16-44f8-97be-2dc8ab6feed6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.547515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abafa822-8c16-44f8-97be-2dc8ab6feed6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.547980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abafa822-8c16-44f8-97be-2dc8ab6feed6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.548438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abafa822-8c16-44f8-97be-2dc8ab6feed6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.579467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-abafa822-8c16-44f8-97be-2dc8ab6feed6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046537 Aug 29 22:51:54.580306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 659/1317] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:54.731923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c1141a14-1b74-41b8-b392-c8c75ec425c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:54.734210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c1141a14-1b74-41b8-b392-c8c75ec425c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:54.741165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1141a14-1b74-41b8-b392-c8c75ec425c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.741656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1141a14-1b74-41b8-b392-c8c75ec425c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.742090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1141a14-1b74-41b8-b392-c8c75ec425c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.742796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1141a14-1b74-41b8-b392-c8c75ec425c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.743271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1141a14-1b74-41b8-b392-c8c75ec425c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.743842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1141a14-1b74-41b8-b392-c8c75ec425c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.777518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c1141a14-1b74-41b8-b392-c8c75ec425c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049612 Aug 29 22:51:54.778093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 659/1318] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:55.269166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:55.270050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:55.276745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.277238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.277674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.278365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.278820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.279248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.342493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:55.346893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-412e1ee8-a38f-4ac7-a879-e783406d822b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:55.349175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-412e1ee8-a38f-4ac7-a879-e783406d822b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:55.350476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-72dae974-cd34-47b2-9771-5e607ecfc6b6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085159 Aug 29 22:51:55.351051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 660/1319] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:55 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:55.355753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-412e1ee8-a38f-4ac7-a879-e783406d822b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.356281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-412e1ee8-a38f-4ac7-a879-e783406d822b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.356718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-412e1ee8-a38f-4ac7-a879-e783406d822b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.357420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-412e1ee8-a38f-4ac7-a879-e783406d822b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.357869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-412e1ee8-a38f-4ac7-a879-e783406d822b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.358418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-412e1ee8-a38f-4ac7-a879-e783406d822b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.391179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-412e1ee8-a38f-4ac7-a879-e783406d822b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048149 Aug 29 22:51:55.391747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 660/1320] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:55 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:55.593032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8178ca2a-0017-4b8f-ad7c-f8c93aa69373 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:55.595142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8178ca2a-0017-4b8f-ad7c-f8c93aa69373 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:55.601934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8178ca2a-0017-4b8f-ad7c-f8c93aa69373 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.602417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8178ca2a-0017-4b8f-ad7c-f8c93aa69373 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.602854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8178ca2a-0017-4b8f-ad7c-f8c93aa69373 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.603545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8178ca2a-0017-4b8f-ad7c-f8c93aa69373 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.604001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8178ca2a-0017-4b8f-ad7c-f8c93aa69373 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.604445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8178ca2a-0017-4b8f-ad7c-f8c93aa69373 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.635052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8178ca2a-0017-4b8f-ad7c-f8c93aa69373 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046053 Aug 29 22:51:55.635627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 661/1321] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:55.791017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-db79cde7-570b-46e1-aa04-73a04001480a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:55.793180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-db79cde7-570b-46e1-aa04-73a04001480a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:55.799240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db79cde7-570b-46e1-aa04-73a04001480a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.799715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db79cde7-570b-46e1-aa04-73a04001480a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.800209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db79cde7-570b-46e1-aa04-73a04001480a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.801725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db79cde7-570b-46e1-aa04-73a04001480a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.802443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db79cde7-570b-46e1-aa04-73a04001480a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.802858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db79cde7-570b-46e1-aa04-73a04001480a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.834568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-db79cde7-570b-46e1-aa04-73a04001480a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047748 Aug 29 22:51:55.835132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 661/1322] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:56.377901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:56.379105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:56.386909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.387391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.387830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.388576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.389036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.389464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.403512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d9c15504-6739-4cbc-bc8b-89cd40af701a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:56.405859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d9c15504-6739-4cbc-bc8b-89cd40af701a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:56.412854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9c15504-6739-4cbc-bc8b-89cd40af701a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.413343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9c15504-6739-4cbc-bc8b-89cd40af701a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.413790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9c15504-6739-4cbc-bc8b-89cd40af701a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.414497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9c15504-6739-4cbc-bc8b-89cd40af701a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.414947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9c15504-6739-4cbc-bc8b-89cd40af701a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.415368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9c15504-6739-4cbc-bc8b-89cd40af701a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.458833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d9c15504-6739-4cbc-bc8b-89cd40af701a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059355 Aug 29 22:51:56.460172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 662/1323] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:51:56.464159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:56.472432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-045b9814-9b17-4431-9443-b2807e9d3c19 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.103226 Aug 29 22:51:56.473033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 662/1324] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:56 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:56.648915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-acc312b0-2abd-4ded-9bc9-456676b09cbf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:56.651144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-acc312b0-2abd-4ded-9bc9-456676b09cbf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:56.657648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acc312b0-2abd-4ded-9bc9-456676b09cbf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.658133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acc312b0-2abd-4ded-9bc9-456676b09cbf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.658569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acc312b0-2abd-4ded-9bc9-456676b09cbf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.659283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acc312b0-2abd-4ded-9bc9-456676b09cbf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.659750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acc312b0-2abd-4ded-9bc9-456676b09cbf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.660507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acc312b0-2abd-4ded-9bc9-456676b09cbf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.697958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-acc312b0-2abd-4ded-9bc9-456676b09cbf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054095 Aug 29 22:51:56.699018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 663/1325] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:56.849119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6fd55dc9-6234-4d2d-bd47-975eb8f507cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:56.851345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6fd55dc9-6234-4d2d-bd47-975eb8f507cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:56.859175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fd55dc9-6234-4d2d-bd47-975eb8f507cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.859667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fd55dc9-6234-4d2d-bd47-975eb8f507cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.860106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fd55dc9-6234-4d2d-bd47-975eb8f507cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.860850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fd55dc9-6234-4d2d-bd47-975eb8f507cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.861309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fd55dc9-6234-4d2d-bd47-975eb8f507cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.861739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fd55dc9-6234-4d2d-bd47-975eb8f507cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.908498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6fd55dc9-6234-4d2d-bd47-975eb8f507cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064884 Aug 29 22:51:56.908941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 663/1326] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:57.471156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f6df03cc-7ee8-4b6b-b5a9-44e10b7ae370 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:57.474871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f6df03cc-7ee8-4b6b-b5a9-44e10b7ae370 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:57.482102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6df03cc-7ee8-4b6b-b5a9-44e10b7ae370 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.482583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6df03cc-7ee8-4b6b-b5a9-44e10b7ae370 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.483014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6df03cc-7ee8-4b6b-b5a9-44e10b7ae370 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.483714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6df03cc-7ee8-4b6b-b5a9-44e10b7ae370 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.484187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6df03cc-7ee8-4b6b-b5a9-44e10b7ae370 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.484617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6df03cc-7ee8-4b6b-b5a9-44e10b7ae370 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.494970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:57.495863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:57.502247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.502721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.503150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.504731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.505434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.506079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.522414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f6df03cc-7ee8-4b6b-b5a9-44e10b7ae370 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055161 Aug 29 22:51:57.522918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 664/1327] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:57.570352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:57.579165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4d8a8842-5e71-4c64-9972-7fb2033c1ae4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087938 Aug 29 22:51:57.579750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 664/1328] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:57 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:57.714487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2ed64ebe-3ff5-4223-990f-ec4d8e90384a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:57.716877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2ed64ebe-3ff5-4223-990f-ec4d8e90384a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:57.718767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:57.723849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed64ebe-3ff5-4223-990f-ec4d8e90384a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.724379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed64ebe-3ff5-4223-990f-ec4d8e90384a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.724815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed64ebe-3ff5-4223-990f-ec4d8e90384a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.725515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed64ebe-3ff5-4223-990f-ec4d8e90384a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.726006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed64ebe-3ff5-4223-990f-ec4d8e90384a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.726440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed64ebe-3ff5-4223-990f-ec4d8e90384a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.753481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:57.759142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2ed64ebe-3ff5-4223-990f-ec4d8e90384a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048694 Aug 29 22:51:57.759743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 665/1329] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:57.921590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-924354fe-33af-4132-9278-46588254480e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:57.923356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-924354fe-33af-4132-9278-46588254480e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:57.930787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-924354fe-33af-4132-9278-46588254480e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.931275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-924354fe-33af-4132-9278-46588254480e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.931706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-924354fe-33af-4132-9278-46588254480e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.932449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-924354fe-33af-4132-9278-46588254480e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.932905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-924354fe-33af-4132-9278-46588254480e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.933328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-924354fe-33af-4132-9278-46588254480e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.965114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-924354fe-33af-4132-9278-46588254480e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047993 Aug 29 22:51:57.965747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 665/1330] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:58.536350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3bb7cb6e-86e2-4f1f-b519-7b172d304dc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:58.538853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3bb7cb6e-86e2-4f1f-b519-7b172d304dc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:58.545820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb7cb6e-86e2-4f1f-b519-7b172d304dc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.546295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb7cb6e-86e2-4f1f-b519-7b172d304dc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.546730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb7cb6e-86e2-4f1f-b519-7b172d304dc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.547425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb7cb6e-86e2-4f1f-b519-7b172d304dc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.547952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb7cb6e-86e2-4f1f-b519-7b172d304dc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.548357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb7cb6e-86e2-4f1f-b519-7b172d304dc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.587802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3bb7cb6e-86e2-4f1f-b519-7b172d304dc3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056573 Aug 29 22:51:58.588417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 666/1331] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:58.601073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:58.601688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:58.608303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.608784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.609222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.609923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.610374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.610797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.675216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:58.683566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ed939bad-f5d1-4d35-a929-bdc1c167df22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086627 Aug 29 22:51:58.684166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 666/1332] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:58 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:58.773513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4e2e3538-f56c-465f-86fc-95da04715ec0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:58.775692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4e2e3538-f56c-465f-86fc-95da04715ec0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:58.781726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e2e3538-f56c-465f-86fc-95da04715ec0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.782319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e2e3538-f56c-465f-86fc-95da04715ec0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.782640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e2e3538-f56c-465f-86fc-95da04715ec0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.783364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e2e3538-f56c-465f-86fc-95da04715ec0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.783811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e2e3538-f56c-465f-86fc-95da04715ec0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.784255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e2e3538-f56c-465f-86fc-95da04715ec0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.817692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4e2e3538-f56c-465f-86fc-95da04715ec0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048491 Aug 29 22:51:58.818184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 667/1333] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:58.977922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-75549e68-73ef-430f-9a8a-93eae03533be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:58.980114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-75549e68-73ef-430f-9a8a-93eae03533be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:58.986154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75549e68-73ef-430f-9a8a-93eae03533be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.986639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75549e68-73ef-430f-9a8a-93eae03533be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.987079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75549e68-73ef-430f-9a8a-93eae03533be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.987775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75549e68-73ef-430f-9a8a-93eae03533be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.988805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75549e68-73ef-430f-9a8a-93eae03533be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.989279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75549e68-73ef-430f-9a8a-93eae03533be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:59.019431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-75549e68-73ef-430f-9a8a-93eae03533be tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045463 Aug 29 22:51:59.020000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 667/1334] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:59.600788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ec6f280c-0318-4b91-ba5b-7b71dfaf994b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:59.603729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ec6f280c-0318-4b91-ba5b-7b71dfaf994b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:59.610412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec6f280c-0318-4b91-ba5b-7b71dfaf994b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:59.611034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec6f280c-0318-4b91-ba5b-7b71dfaf994b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:59.611476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec6f280c-0318-4b91-ba5b-7b71dfaf994b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:59.612198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec6f280c-0318-4b91-ba5b-7b71dfaf994b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:59.612648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec6f280c-0318-4b91-ba5b-7b71dfaf994b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:59.613659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec6f280c-0318-4b91-ba5b-7b71dfaf994b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:59.644216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ec6f280c-0318-4b91-ba5b-7b71dfaf994b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047909 Aug 29 22:51:59.654460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 668/1335] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:51:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:59.703754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:59.704419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:59.712151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:59.712646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:59.713146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:59.713783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:59.714304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:59.714652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:59.779738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:59.789481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-aa30de8c-8cf1-4c00-b8aa-cb898efc5121 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089481 Aug 29 22:51:59.790337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 668/1336] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:59 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:59.830464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7b6c299a-78c1-4999-9c2b-fcef080e975d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:59.833248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7b6c299a-78c1-4999-9c2b-fcef080e975d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:59.839371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b6c299a-78c1-4999-9c2b-fcef080e975d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:59.839843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b6c299a-78c1-4999-9c2b-fcef080e975d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:59.840304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b6c299a-78c1-4999-9c2b-fcef080e975d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:59.840988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b6c299a-78c1-4999-9c2b-fcef080e975d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:59.841433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b6c299a-78c1-4999-9c2b-fcef080e975d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:59.841842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b6c299a-78c1-4999-9c2b-fcef080e975d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:59.874275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7b6c299a-78c1-4999-9c2b-fcef080e975d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048086 Aug 29 22:51:59.874853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 669/1337] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:51:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:00.031289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ff666830-f288-46d5-894b-15e0b4ebdffd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:00.033522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ff666830-f288-46d5-894b-15e0b4ebdffd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:00.041077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff666830-f288-46d5-894b-15e0b4ebdffd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:00.041561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff666830-f288-46d5-894b-15e0b4ebdffd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:00.041997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff666830-f288-46d5-894b-15e0b4ebdffd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:00.042737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff666830-f288-46d5-894b-15e0b4ebdffd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:00.043187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff666830-f288-46d5-894b-15e0b4ebdffd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:00.043613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff666830-f288-46d5-894b-15e0b4ebdffd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:00.075178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ff666830-f288-46d5-894b-15e0b4ebdffd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047846 Aug 29 22:52:00.075754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 669/1338] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:00.663386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-24a3b00a-fdbf-488e-8ea9-b311a3fc896b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:00.665633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-24a3b00a-fdbf-488e-8ea9-b311a3fc896b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:00.672157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24a3b00a-fdbf-488e-8ea9-b311a3fc896b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:00.672642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24a3b00a-fdbf-488e-8ea9-b311a3fc896b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:00.673076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24a3b00a-fdbf-488e-8ea9-b311a3fc896b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:00.673768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24a3b00a-fdbf-488e-8ea9-b311a3fc896b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:00.674222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24a3b00a-fdbf-488e-8ea9-b311a3fc896b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:00.674647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24a3b00a-fdbf-488e-8ea9-b311a3fc896b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:00.706122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-24a3b00a-fdbf-488e-8ea9-b311a3fc896b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046938 Aug 29 22:52:00.706695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 670/1339] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:00.810067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:00.810796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:00.817299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:00.818258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:00.818558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:00.819258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:00.819710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:00.820162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:00.886523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:00.887393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7d1db4a1-dc8f-433f-9815-3f8b0b471567 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:00.889689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7d1db4a1-dc8f-433f-9815-3f8b0b471567 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:00.897265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d1db4a1-dc8f-433f-9815-3f8b0b471567 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:00.897591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-99f25f56-1eb1-4c63-8ed6-19f7618d29ce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091160 Aug 29 22:52:00.897777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d1db4a1-dc8f-433f-9815-3f8b0b471567 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:00.898175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d1db4a1-dc8f-433f-9815-3f8b0b471567 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:00.898812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 670/1340] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:00 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:00.898975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d1db4a1-dc8f-433f-9815-3f8b0b471567 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:00.899324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d1db4a1-dc8f-433f-9815-3f8b0b471567 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:00.899787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d1db4a1-dc8f-433f-9815-3f8b0b471567 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:00.934477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7d1db4a1-dc8f-433f-9815-3f8b0b471567 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051199 Aug 29 22:52:00.935050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 671/1341] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:01.088289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-605b00cb-cc8e-436d-ae1b-c089e2860450 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:01.090395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-605b00cb-cc8e-436d-ae1b-c089e2860450 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:01.096467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-605b00cb-cc8e-436d-ae1b-c089e2860450 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.096956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-605b00cb-cc8e-436d-ae1b-c089e2860450 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.097408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-605b00cb-cc8e-436d-ae1b-c089e2860450 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:01.098366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-605b00cb-cc8e-436d-ae1b-c089e2860450 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.098831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-605b00cb-cc8e-436d-ae1b-c089e2860450 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.099259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-605b00cb-cc8e-436d-ae1b-c089e2860450 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:01.102021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:01.132743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-605b00cb-cc8e-436d-ae1b-c089e2860450 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048482 Aug 29 22:52:01.133321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 671/1342] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:01.718648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5afc41e5-317a-4467-963b-1e90eaf9574a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:01.721299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5afc41e5-317a-4467-963b-1e90eaf9574a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:01.728934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5afc41e5-317a-4467-963b-1e90eaf9574a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.729414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5afc41e5-317a-4467-963b-1e90eaf9574a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.729847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5afc41e5-317a-4467-963b-1e90eaf9574a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:01.730548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5afc41e5-317a-4467-963b-1e90eaf9574a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.730993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5afc41e5-317a-4467-963b-1e90eaf9574a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.731411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5afc41e5-317a-4467-963b-1e90eaf9574a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:01.764569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5afc41e5-317a-4467-963b-1e90eaf9574a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049825 Aug 29 22:52:01.765132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 672/1343] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:01.920053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:01.921049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:01.924456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:01.933294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.938026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.938026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:01.938026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.938026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.938455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:01.955432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8c691b05-e30f-4c6b-81ed-c441c4b55f8f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:01.959422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8c691b05-e30f-4c6b-81ed-c441c4b55f8f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:01.968728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c691b05-e30f-4c6b-81ed-c441c4b55f8f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.969512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c691b05-e30f-4c6b-81ed-c441c4b55f8f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.970229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c691b05-e30f-4c6b-81ed-c441c4b55f8f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:01.971324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c691b05-e30f-4c6b-81ed-c441c4b55f8f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.972060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c691b05-e30f-4c6b-81ed-c441c4b55f8f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.973431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c691b05-e30f-4c6b-81ed-c441c4b55f8f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:02.008974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8c691b05-e30f-4c6b-81ed-c441c4b55f8f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060807 Aug 29 22:52:02.009570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 673/1344] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:02.014429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:02.023681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2474bd16-d50f-448e-a9f1-e2ba6ac5de0d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.108210 Aug 29 22:52:02.024268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 672/1345] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:01 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:02.146620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-86a1e682-5fc7-4122-81bc-3faea86dafef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:02.148810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-86a1e682-5fc7-4122-81bc-3faea86dafef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:02.155182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a1e682-5fc7-4122-81bc-3faea86dafef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:02.155691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a1e682-5fc7-4122-81bc-3faea86dafef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:02.156116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a1e682-5fc7-4122-81bc-3faea86dafef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:02.156852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a1e682-5fc7-4122-81bc-3faea86dafef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:02.157297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a1e682-5fc7-4122-81bc-3faea86dafef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:02.157821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a1e682-5fc7-4122-81bc-3faea86dafef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:02.187555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-86a1e682-5fc7-4122-81bc-3faea86dafef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 Aug 29 22:52:02.188050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 674/1346] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:02.778273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-959a6f7a-899b-4065-9d65-890caf72819f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:02.780466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-959a6f7a-899b-4065-9d65-890caf72819f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:02.787422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-959a6f7a-899b-4065-9d65-890caf72819f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:02.787888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-959a6f7a-899b-4065-9d65-890caf72819f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:02.788363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-959a6f7a-899b-4065-9d65-890caf72819f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:02.789059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-959a6f7a-899b-4065-9d65-890caf72819f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:02.789510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-959a6f7a-899b-4065-9d65-890caf72819f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:02.789934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-959a6f7a-899b-4065-9d65-890caf72819f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:02.819573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-959a6f7a-899b-4065-9d65-890caf72819f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045276 Aug 29 22:52:02.820158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 673/1347] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:03.022246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-799d2ee5-3390-468d-8f86-db5fe2fa9b07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:03.024381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-799d2ee5-3390-468d-8f86-db5fe2fa9b07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:03.031031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799d2ee5-3390-468d-8f86-db5fe2fa9b07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.031441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799d2ee5-3390-468d-8f86-db5fe2fa9b07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.031873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799d2ee5-3390-468d-8f86-db5fe2fa9b07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.032602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799d2ee5-3390-468d-8f86-db5fe2fa9b07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.033070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799d2ee5-3390-468d-8f86-db5fe2fa9b07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.033473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799d2ee5-3390-468d-8f86-db5fe2fa9b07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.045030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:03.045907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:03.053341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.053824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.054261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.054954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.055438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.055868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.066194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-799d2ee5-3390-468d-8f86-db5fe2fa9b07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048609 Aug 29 22:52:03.067696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 675/1348] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:03.118480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:03.126563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0394ca2b-a0ad-413a-b235-d238ecc06430 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085477 Aug 29 22:52:03.127137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 674/1349] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:03 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:03.200159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4c98f517-a23a-4a19-9f78-73c656ca1f1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:03.202328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4c98f517-a23a-4a19-9f78-73c656ca1f1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:03.208983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c98f517-a23a-4a19-9f78-73c656ca1f1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.209468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c98f517-a23a-4a19-9f78-73c656ca1f1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.209902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c98f517-a23a-4a19-9f78-73c656ca1f1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.210595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c98f517-a23a-4a19-9f78-73c656ca1f1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.211045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c98f517-a23a-4a19-9f78-73c656ca1f1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.211463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c98f517-a23a-4a19-9f78-73c656ca1f1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.243008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4c98f517-a23a-4a19-9f78-73c656ca1f1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046812 Aug 29 22:52:03.243576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 676/1350] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:03.832474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-137f9ec2-b83b-4bca-90a6-fe105a85c4c8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:03.834635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-137f9ec2-b83b-4bca-90a6-fe105a85c4c8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:03.840595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-137f9ec2-b83b-4bca-90a6-fe105a85c4c8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.841075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-137f9ec2-b83b-4bca-90a6-fe105a85c4c8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.841510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-137f9ec2-b83b-4bca-90a6-fe105a85c4c8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.842280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-137f9ec2-b83b-4bca-90a6-fe105a85c4c8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.842662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-137f9ec2-b83b-4bca-90a6-fe105a85c4c8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.843079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-137f9ec2-b83b-4bca-90a6-fe105a85c4c8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.874171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-137f9ec2-b83b-4bca-90a6-fe105a85c4c8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045919 Aug 29 22:52:03.874737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 675/1351] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:04.079265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e540544d-f148-4d65-b690-78acab0985b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:04.081675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e540544d-f148-4d65-b690-78acab0985b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:04.088165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e540544d-f148-4d65-b690-78acab0985b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.088646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e540544d-f148-4d65-b690-78acab0985b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.089072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e540544d-f148-4d65-b690-78acab0985b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.089755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e540544d-f148-4d65-b690-78acab0985b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.090198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e540544d-f148-4d65-b690-78acab0985b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.090611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e540544d-f148-4d65-b690-78acab0985b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.121755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e540544d-f148-4d65-b690-78acab0985b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046452 Aug 29 22:52:04.122301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 677/1352] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:04.147577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:04.149017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:04.158233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.158718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.159156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.160410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.160869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.161287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.226136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:04.234044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-45209dd7-dce9-4160-9215-211441979a08 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091124 Aug 29 22:52:04.234608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 676/1353] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:04 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:04.258378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e0ce6a6c-00af-4e26-8144-ad9cbaffe125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:04.260656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e0ce6a6c-00af-4e26-8144-ad9cbaffe125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:04.266661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ce6a6c-00af-4e26-8144-ad9cbaffe125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.267137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ce6a6c-00af-4e26-8144-ad9cbaffe125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.267563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ce6a6c-00af-4e26-8144-ad9cbaffe125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.268283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ce6a6c-00af-4e26-8144-ad9cbaffe125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.268733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ce6a6c-00af-4e26-8144-ad9cbaffe125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.269639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ce6a6c-00af-4e26-8144-ad9cbaffe125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.299753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e0ce6a6c-00af-4e26-8144-ad9cbaffe125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048529 Aug 29 22:52:04.300365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 678/1354] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:04.886138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-de700b1b-4d73-47a1-89f4-305d6bec70eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:04.888356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-de700b1b-4d73-47a1-89f4-305d6bec70eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:04.896650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de700b1b-4d73-47a1-89f4-305d6bec70eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.897129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de700b1b-4d73-47a1-89f4-305d6bec70eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.897559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de700b1b-4d73-47a1-89f4-305d6bec70eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.898254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de700b1b-4d73-47a1-89f4-305d6bec70eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.898708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de700b1b-4d73-47a1-89f4-305d6bec70eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.899115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de700b1b-4d73-47a1-89f4-305d6bec70eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.931434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-de700b1b-4d73-47a1-89f4-305d6bec70eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049219 Aug 29 22:52:05.056395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 677/1355] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:05.134611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2ffd2168-339e-4156-8541-1ead9d0eae11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:05.136867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2ffd2168-339e-4156-8541-1ead9d0eae11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:05.143238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ffd2168-339e-4156-8541-1ead9d0eae11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.143713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ffd2168-339e-4156-8541-1ead9d0eae11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.145031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ffd2168-339e-4156-8541-1ead9d0eae11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.145726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ffd2168-339e-4156-8541-1ead9d0eae11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.146189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ffd2168-339e-4156-8541-1ead9d0eae11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.146590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ffd2168-339e-4156-8541-1ead9d0eae11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.178275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2ffd2168-339e-4156-8541-1ead9d0eae11 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047936 Aug 29 22:52:05.178841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 679/1356] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:05 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:05.255040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:05.255847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:05.262211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.262696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.263129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.263826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.264324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.264747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.312150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f9302f16-714b-4011-a879-5d97c3bbdd4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:05.314554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f9302f16-714b-4011-a879-5d97c3bbdd4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:05.320617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9302f16-714b-4011-a879-5d97c3bbdd4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.321079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9302f16-714b-4011-a879-5d97c3bbdd4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.321507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9302f16-714b-4011-a879-5d97c3bbdd4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.322202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9302f16-714b-4011-a879-5d97c3bbdd4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.322701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9302f16-714b-4011-a879-5d97c3bbdd4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.323171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9302f16-714b-4011-a879-5d97c3bbdd4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.329504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:05.338047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-80d99fe8-c1cf-4846-a74c-64bb16d3dfa1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087625 Aug 29 22:52:05.338725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 678/1357] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:05 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:05.353367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f9302f16-714b-4011-a879-5d97c3bbdd4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045250 Aug 29 22:52:05.353929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 680/1358] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:05.944881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-66a2d4bd-1ab2-4332-9a6e-c31581f53783 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:05.947130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-66a2d4bd-1ab2-4332-9a6e-c31581f53783 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:05.954109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a2d4bd-1ab2-4332-9a6e-c31581f53783 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.954595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a2d4bd-1ab2-4332-9a6e-c31581f53783 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.955277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a2d4bd-1ab2-4332-9a6e-c31581f53783 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.955971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a2d4bd-1ab2-4332-9a6e-c31581f53783 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:05.956447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a2d4bd-1ab2-4332-9a6e-c31581f53783 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:05.956868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66a2d4bd-1ab2-4332-9a6e-c31581f53783 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.987019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-66a2d4bd-1ab2-4332-9a6e-c31581f53783 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046770 Aug 29 22:52:05.987582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 679/1359] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:06.191188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a954a67a-80be-4e2a-a1e7-f207a1e1f979 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:06.193525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a954a67a-80be-4e2a-a1e7-f207a1e1f979 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:06.200168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a954a67a-80be-4e2a-a1e7-f207a1e1f979 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.200660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a954a67a-80be-4e2a-a1e7-f207a1e1f979 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.201093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a954a67a-80be-4e2a-a1e7-f207a1e1f979 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.201788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a954a67a-80be-4e2a-a1e7-f207a1e1f979 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.202240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a954a67a-80be-4e2a-a1e7-f207a1e1f979 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.202669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a954a67a-80be-4e2a-a1e7-f207a1e1f979 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.235201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a954a67a-80be-4e2a-a1e7-f207a1e1f979 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048114 Aug 29 22:52:06.235791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 681/1360] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:06.359915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:06.360568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:06.366568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-798d3f90-34e2-4bdc-9bc5-01670191b67e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:06.367972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.368509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.368837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-798d3f90-34e2-4bdc-9bc5-01670191b67e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:06.368982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.369642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.370202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.370631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.376613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-798d3f90-34e2-4bdc-9bc5-01670191b67e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.376613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-798d3f90-34e2-4bdc-9bc5-01670191b67e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.376613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-798d3f90-34e2-4bdc-9bc5-01670191b67e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.377034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-798d3f90-34e2-4bdc-9bc5-01670191b67e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.377447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-798d3f90-34e2-4bdc-9bc5-01670191b67e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.377875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-798d3f90-34e2-4bdc-9bc5-01670191b67e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.400557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:06.417162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-798d3f90-34e2-4bdc-9bc5-01670191b67e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055553 Aug 29 22:52:06.417976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 682/1361] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:06.449452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:06.458721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0b46947b-5c4c-400d-bbb1-09c9cc5a1042 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.102570 Aug 29 22:52:06.459318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 680/1362] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:06 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:07.000816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dedaee03-1f1d-44cd-b777-2eb9ce48f025 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:07.002967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dedaee03-1f1d-44cd-b777-2eb9ce48f025 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:07.010031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dedaee03-1f1d-44cd-b777-2eb9ce48f025 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.010521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dedaee03-1f1d-44cd-b777-2eb9ce48f025 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.010956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dedaee03-1f1d-44cd-b777-2eb9ce48f025 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.011646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dedaee03-1f1d-44cd-b777-2eb9ce48f025 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.012098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dedaee03-1f1d-44cd-b777-2eb9ce48f025 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.012549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dedaee03-1f1d-44cd-b777-2eb9ce48f025 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.042708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dedaee03-1f1d-44cd-b777-2eb9ce48f025 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046186 Aug 29 22:52:07.043282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 683/1363] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:07.248760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-747269d9-15ac-4eb9-8b19-faa4ac6186a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:07.250958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-747269d9-15ac-4eb9-8b19-faa4ac6186a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:07.257902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-747269d9-15ac-4eb9-8b19-faa4ac6186a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.258389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-747269d9-15ac-4eb9-8b19-faa4ac6186a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.258865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-747269d9-15ac-4eb9-8b19-faa4ac6186a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.259572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-747269d9-15ac-4eb9-8b19-faa4ac6186a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.260028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-747269d9-15ac-4eb9-8b19-faa4ac6186a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.260490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-747269d9-15ac-4eb9-8b19-faa4ac6186a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.291933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-747269d9-15ac-4eb9-8b19-faa4ac6186a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047498 Aug 29 22:52:07.292535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 681/1364] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:07.434387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5986c1d1-4ee7-4f23-a6c6-8e450b42512a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:07.436696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5986c1d1-4ee7-4f23-a6c6-8e450b42512a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:07.444401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5986c1d1-4ee7-4f23-a6c6-8e450b42512a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.444891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5986c1d1-4ee7-4f23-a6c6-8e450b42512a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.445323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5986c1d1-4ee7-4f23-a6c6-8e450b42512a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.446023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5986c1d1-4ee7-4f23-a6c6-8e450b42512a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.446470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5986c1d1-4ee7-4f23-a6c6-8e450b42512a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.446897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5986c1d1-4ee7-4f23-a6c6-8e450b42512a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.477493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5986c1d1-4ee7-4f23-a6c6-8e450b42512a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048260 Aug 29 22:52:07.478073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 684/1365] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:07.481005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:07.481624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:07.488802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.489405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.489845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.490595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.491043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.491469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.556031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:07.563833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5a8116b1-8e4f-48a8-84ba-981e5b307f67 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087054 Aug 29 22:52:07.564428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 682/1366] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:07 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:08.055634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-065e5c07-cab3-4789-8b88-cb970b251ce7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:08.057854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-065e5c07-cab3-4789-8b88-cb970b251ce7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:08.063879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-065e5c07-cab3-4789-8b88-cb970b251ce7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.064405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-065e5c07-cab3-4789-8b88-cb970b251ce7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.064857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-065e5c07-cab3-4789-8b88-cb970b251ce7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.065540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-065e5c07-cab3-4789-8b88-cb970b251ce7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.066603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-065e5c07-cab3-4789-8b88-cb970b251ce7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.067024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-065e5c07-cab3-4789-8b88-cb970b251ce7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.097939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-065e5c07-cab3-4789-8b88-cb970b251ce7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046053 Aug 29 22:52:08.098517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 685/1367] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:08.305059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a82d7aba-d934-4421-8f05-e025e9e5c33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:08.307144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a82d7aba-d934-4421-8f05-e025e9e5c33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:08.313176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82d7aba-d934-4421-8f05-e025e9e5c33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.313651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82d7aba-d934-4421-8f05-e025e9e5c33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.314086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82d7aba-d934-4421-8f05-e025e9e5c33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.314782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82d7aba-d934-4421-8f05-e025e9e5c33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.315232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82d7aba-d934-4421-8f05-e025e9e5c33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.315656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82d7aba-d934-4421-8f05-e025e9e5c33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.346627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a82d7aba-d934-4421-8f05-e025e9e5c33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046604 Aug 29 22:52:08.347710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 683/1368] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:08.490644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6f659f6d-37c6-4288-8fee-076c26dd7c05 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:08.492873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6f659f6d-37c6-4288-8fee-076c26dd7c05 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:08.499237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f659f6d-37c6-4288-8fee-076c26dd7c05 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.499711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f659f6d-37c6-4288-8fee-076c26dd7c05 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.500159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f659f6d-37c6-4288-8fee-076c26dd7c05 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.500855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f659f6d-37c6-4288-8fee-076c26dd7c05 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.501301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f659f6d-37c6-4288-8fee-076c26dd7c05 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.501737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f659f6d-37c6-4288-8fee-076c26dd7c05 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.536123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6f659f6d-37c6-4288-8fee-076c26dd7c05 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049824 Aug 29 22:52:08.536725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 686/1369] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:08.584954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:08.585521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:08.591983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.592508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.592942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.593636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.594090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.594522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.658876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:08.667375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a24f7bff-0817-4c7b-ac55-c58d2091916a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086385 Aug 29 22:52:08.667954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 684/1370] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:08 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:09.110418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-315cfc3c-a525-49fe-8f3a-fc470ffbe19c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:09.112627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-315cfc3c-a525-49fe-8f3a-fc470ffbe19c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:09.118820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-315cfc3c-a525-49fe-8f3a-fc470ffbe19c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.119298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-315cfc3c-a525-49fe-8f3a-fc470ffbe19c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.119735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-315cfc3c-a525-49fe-8f3a-fc470ffbe19c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:09.120607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-315cfc3c-a525-49fe-8f3a-fc470ffbe19c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.120941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-315cfc3c-a525-49fe-8f3a-fc470ffbe19c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.121362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-315cfc3c-a525-49fe-8f3a-fc470ffbe19c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:09.153378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-315cfc3c-a525-49fe-8f3a-fc470ffbe19c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046840 Aug 29 22:52:09.153863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 687/1371] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:09.359165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d44574e1-09f3-4ea5-a524-957a7230cbb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:09.361395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d44574e1-09f3-4ea5-a524-957a7230cbb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:09.367783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d44574e1-09f3-4ea5-a524-957a7230cbb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.368306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d44574e1-09f3-4ea5-a524-957a7230cbb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.368745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d44574e1-09f3-4ea5-a524-957a7230cbb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:09.369466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d44574e1-09f3-4ea5-a524-957a7230cbb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.369922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d44574e1-09f3-4ea5-a524-957a7230cbb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.370348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d44574e1-09f3-4ea5-a524-957a7230cbb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:09.402049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d44574e1-09f3-4ea5-a524-957a7230cbb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046812 Aug 29 22:52:09.402640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 685/1372] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:09 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:09.548564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e73d3e50-a427-4d32-a065-4c167570d1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:09.550692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e73d3e50-a427-4d32-a065-4c167570d1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:09.557493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e73d3e50-a427-4d32-a065-4c167570d1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.557981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e73d3e50-a427-4d32-a065-4c167570d1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.558408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e73d3e50-a427-4d32-a065-4c167570d1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:09.559113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e73d3e50-a427-4d32-a065-4c167570d1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.559558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e73d3e50-a427-4d32-a065-4c167570d1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.559975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e73d3e50-a427-4d32-a065-4c167570d1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:09.597635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e73d3e50-a427-4d32-a065-4c167570d1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052460 Aug 29 22:52:09.598631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 688/1373] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:09.689016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:09.689692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:09.696658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.697147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.697579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:09.698286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.698739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.700227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:09.769016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:09.777177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1c8a7985-9ce5-47c3-a073-b82a96183e22 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092002 Aug 29 22:52:09.777753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 686/1374] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:09 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:10.165793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3b756351-a4df-4f94-9b89-7df7c28b30cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:10.168004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3b756351-a4df-4f94-9b89-7df7c28b30cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:10.174528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b756351-a4df-4f94-9b89-7df7c28b30cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.174938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b756351-a4df-4f94-9b89-7df7c28b30cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.175910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b756351-a4df-4f94-9b89-7df7c28b30cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.176635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b756351-a4df-4f94-9b89-7df7c28b30cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.177088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b756351-a4df-4f94-9b89-7df7c28b30cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.177506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b756351-a4df-4f94-9b89-7df7c28b30cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.209151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3b756351-a4df-4f94-9b89-7df7c28b30cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047241 Aug 29 22:52:10.209590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 689/1375] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:10.417894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-608f7abb-ffea-465f-9761-e4f7bd8849a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:10.420171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-608f7abb-ffea-465f-9761-e4f7bd8849a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:10.426593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608f7abb-ffea-465f-9761-e4f7bd8849a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.426986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608f7abb-ffea-465f-9761-e4f7bd8849a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.427423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608f7abb-ffea-465f-9761-e4f7bd8849a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.428118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608f7abb-ffea-465f-9761-e4f7bd8849a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.428594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608f7abb-ffea-465f-9761-e4f7bd8849a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.429014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608f7abb-ffea-465f-9761-e4f7bd8849a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.454459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:10.460045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-608f7abb-ffea-465f-9761-e4f7bd8849a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048503 Aug 29 22:52:10.465409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 687/1376] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:10.610541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3d6ad0bc-2e0c-4687-b036-59ed919cf13c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:10.613275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3d6ad0bc-2e0c-4687-b036-59ed919cf13c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:10.619728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d6ad0bc-2e0c-4687-b036-59ed919cf13c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.620232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d6ad0bc-2e0c-4687-b036-59ed919cf13c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.620666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d6ad0bc-2e0c-4687-b036-59ed919cf13c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.621347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d6ad0bc-2e0c-4687-b036-59ed919cf13c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.621789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d6ad0bc-2e0c-4687-b036-59ed919cf13c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.622211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d6ad0bc-2e0c-4687-b036-59ed919cf13c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.651132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3d6ad0bc-2e0c-4687-b036-59ed919cf13c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Aug 29 22:52:10.651674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 690/1377] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:10.798905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:10.799555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:10.807069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.807546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.808078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.808732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.809183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.809604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.879131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:10.889038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-95b008f0-82ce-4b3e-8838-fc03bbf64816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094065 Aug 29 22:52:10.889477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 688/1378] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:10 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:11.222526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c58ba958-5f61-48bd-8acd-0fc5118772d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:11.224819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c58ba958-5f61-48bd-8acd-0fc5118772d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:11.231178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c58ba958-5f61-48bd-8acd-0fc5118772d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.231663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c58ba958-5f61-48bd-8acd-0fc5118772d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.232090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c58ba958-5f61-48bd-8acd-0fc5118772d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.232810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c58ba958-5f61-48bd-8acd-0fc5118772d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.233255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c58ba958-5f61-48bd-8acd-0fc5118772d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.233671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c58ba958-5f61-48bd-8acd-0fc5118772d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.264708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c58ba958-5f61-48bd-8acd-0fc5118772d9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046829 Aug 29 22:52:11.265280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 691/1379] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:11.476576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d76800df-bf2b-4e6b-b615-89c3788814b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:11.479131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d76800df-bf2b-4e6b-b615-89c3788814b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:11.486170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d76800df-bf2b-4e6b-b615-89c3788814b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.486645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d76800df-bf2b-4e6b-b615-89c3788814b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.487079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d76800df-bf2b-4e6b-b615-89c3788814b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.488306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d76800df-bf2b-4e6b-b615-89c3788814b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.488763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d76800df-bf2b-4e6b-b615-89c3788814b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.489184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d76800df-bf2b-4e6b-b615-89c3788814b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.521284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d76800df-bf2b-4e6b-b615-89c3788814b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049397 Aug 29 22:52:11.521857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 689/1380] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:11 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:11.664182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-90510702-850c-4e1c-a05e-892de72015fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:11.666465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-90510702-850c-4e1c-a05e-892de72015fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:11.673032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90510702-850c-4e1c-a05e-892de72015fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.673541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90510702-850c-4e1c-a05e-892de72015fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.673973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90510702-850c-4e1c-a05e-892de72015fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.674696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90510702-850c-4e1c-a05e-892de72015fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.675788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90510702-850c-4e1c-a05e-892de72015fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.676235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90510702-850c-4e1c-a05e-892de72015fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.707109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-90510702-850c-4e1c-a05e-892de72015fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Aug 29 22:52:11.707673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 692/1381] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:11.911280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:11.912105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:11.918911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.919386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.919817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.920624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.921009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.921434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.989829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:11.997635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-426131c8-1721-4778-8689-d22f05456988 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090560 Aug 29 22:52:11.998205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 690/1382] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:11 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:12.278007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-425e8724-553b-4400-a131-379a054d01c7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:12.280189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-425e8724-553b-4400-a131-379a054d01c7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:12.286425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-425e8724-553b-4400-a131-379a054d01c7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.286903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-425e8724-553b-4400-a131-379a054d01c7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.287339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-425e8724-553b-4400-a131-379a054d01c7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.288041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-425e8724-553b-4400-a131-379a054d01c7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.288504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-425e8724-553b-4400-a131-379a054d01c7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.288924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-425e8724-553b-4400-a131-379a054d01c7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.321388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-425e8724-553b-4400-a131-379a054d01c7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047322 Aug 29 22:52:12.321961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 693/1383] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:12.534191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-607e9163-2eca-4a25-92a1-bfbecb1a47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:12.536540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-607e9163-2eca-4a25-92a1-bfbecb1a47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:12.542584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-607e9163-2eca-4a25-92a1-bfbecb1a47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.543060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-607e9163-2eca-4a25-92a1-bfbecb1a47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.543495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-607e9163-2eca-4a25-92a1-bfbecb1a47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.544231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-607e9163-2eca-4a25-92a1-bfbecb1a47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.544682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-607e9163-2eca-4a25-92a1-bfbecb1a47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.545099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-607e9163-2eca-4a25-92a1-bfbecb1a47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.576979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-607e9163-2eca-4a25-92a1-bfbecb1a47f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047005 Aug 29 22:52:12.577540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 691/1384] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:12.719568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cfb00863-23f6-4075-a9d0-2e19d41316bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:12.721895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cfb00863-23f6-4075-a9d0-2e19d41316bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:12.728987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfb00863-23f6-4075-a9d0-2e19d41316bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.729425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfb00863-23f6-4075-a9d0-2e19d41316bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.729857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfb00863-23f6-4075-a9d0-2e19d41316bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.730572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfb00863-23f6-4075-a9d0-2e19d41316bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.731013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfb00863-23f6-4075-a9d0-2e19d41316bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.731437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfb00863-23f6-4075-a9d0-2e19d41316bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.764192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cfb00863-23f6-4075-a9d0-2e19d41316bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048532 Aug 29 22:52:12.764781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 694/1385] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:13.018500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:13.019118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:13.025707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.026196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.026627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.027307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.027814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.028276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.093877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:13.102576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f0131061-bb34-457d-8009-e8f68afa54f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087863 Aug 29 22:52:13.103168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 692/1386] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:13 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:13.335094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-97f09ce5-afeb-442e-bd57-77cbbaf9e11d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:13.337383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-97f09ce5-afeb-442e-bd57-77cbbaf9e11d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:13.344050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f09ce5-afeb-442e-bd57-77cbbaf9e11d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.347817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f09ce5-afeb-442e-bd57-77cbbaf9e11d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.347817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f09ce5-afeb-442e-bd57-77cbbaf9e11d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.347817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f09ce5-afeb-442e-bd57-77cbbaf9e11d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.347817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f09ce5-afeb-442e-bd57-77cbbaf9e11d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.348369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f09ce5-afeb-442e-bd57-77cbbaf9e11d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.378841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-97f09ce5-afeb-442e-bd57-77cbbaf9e11d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048645 Aug 29 22:52:13.379431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 695/1387] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:13.589801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a8a03bb0-1aae-49c6-a658-776441282ee8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:13.591884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a8a03bb0-1aae-49c6-a658-776441282ee8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:13.598070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8a03bb0-1aae-49c6-a658-776441282ee8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.598623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8a03bb0-1aae-49c6-a658-776441282ee8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.599068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8a03bb0-1aae-49c6-a658-776441282ee8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.599771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8a03bb0-1aae-49c6-a658-776441282ee8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.600255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8a03bb0-1aae-49c6-a658-776441282ee8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.600691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8a03bb0-1aae-49c6-a658-776441282ee8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.631580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a8a03bb0-1aae-49c6-a658-776441282ee8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Aug 29 22:52:13.632163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 693/1388] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:13.781223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-df78b738-151c-4ff4-848a-5c741d26a51b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:13.785065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-df78b738-151c-4ff4-848a-5c741d26a51b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:13.792994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df78b738-151c-4ff4-848a-5c741d26a51b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.793482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df78b738-151c-4ff4-848a-5c741d26a51b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.793925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df78b738-151c-4ff4-848a-5c741d26a51b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.794629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df78b738-151c-4ff4-848a-5c741d26a51b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.795083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df78b738-151c-4ff4-848a-5c741d26a51b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.796279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df78b738-151c-4ff4-848a-5c741d26a51b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.827655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-df78b738-151c-4ff4-848a-5c741d26a51b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053744 Aug 29 22:52:13.828257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 696/1389] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:14.123936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:14.124601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:14.132194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.132688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.133121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.133826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.134276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.134699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.204404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:14.212757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-151af392-e136-49ec-8c5a-0a600fc8a2b4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092680 Aug 29 22:52:14.213346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 694/1390] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:14 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:14.392184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-70ff7687-7486-4fe6-ad24-25a091f72918 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:14.394370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-70ff7687-7486-4fe6-ad24-25a091f72918 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:14.400967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70ff7687-7486-4fe6-ad24-25a091f72918 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.401452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70ff7687-7486-4fe6-ad24-25a091f72918 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.401913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70ff7687-7486-4fe6-ad24-25a091f72918 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.402622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70ff7687-7486-4fe6-ad24-25a091f72918 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.403066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70ff7687-7486-4fe6-ad24-25a091f72918 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.403482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70ff7687-7486-4fe6-ad24-25a091f72918 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.438537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-70ff7687-7486-4fe6-ad24-25a091f72918 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050554 Aug 29 22:52:14.439123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 697/1391] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:14.644022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9530eeef-a1b7-45f7-a4cb-dea16224bcbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:14.646432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9530eeef-a1b7-45f7-a4cb-dea16224bcbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:14.652469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9530eeef-a1b7-45f7-a4cb-dea16224bcbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.653023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9530eeef-a1b7-45f7-a4cb-dea16224bcbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.653362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9530eeef-a1b7-45f7-a4cb-dea16224bcbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.654062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9530eeef-a1b7-45f7-a4cb-dea16224bcbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.654513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9530eeef-a1b7-45f7-a4cb-dea16224bcbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.654940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9530eeef-a1b7-45f7-a4cb-dea16224bcbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.686000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9530eeef-a1b7-45f7-a4cb-dea16224bcbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Aug 29 22:52:14.686567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 695/1392] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:14.841427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6e96189f-87b9-42a4-9ca4-fba86a20806a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:14.843747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6e96189f-87b9-42a4-9ca4-fba86a20806a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:14.851310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e96189f-87b9-42a4-9ca4-fba86a20806a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.851798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e96189f-87b9-42a4-9ca4-fba86a20806a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.852290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e96189f-87b9-42a4-9ca4-fba86a20806a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.853000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e96189f-87b9-42a4-9ca4-fba86a20806a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.853443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e96189f-87b9-42a4-9ca4-fba86a20806a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.853866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e96189f-87b9-42a4-9ca4-fba86a20806a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.891354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6e96189f-87b9-42a4-9ca4-fba86a20806a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053611 Aug 29 22:52:14.892476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 698/1393] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:15.233983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:15.234534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:15.241121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.241595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.242022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.242707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.243155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.243572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.307099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:15.317597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8cf97b95-723c-49f0-b087-5ebed3a7ccd1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087347 Aug 29 22:52:15.318197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 696/1394] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:15 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:15.451286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ddb42954-4d72-4333-923d-ee6251c184d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:15.453459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ddb42954-4d72-4333-923d-ee6251c184d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:15.461284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ddb42954-4d72-4333-923d-ee6251c184d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.461771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ddb42954-4d72-4333-923d-ee6251c184d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.462212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ddb42954-4d72-4333-923d-ee6251c184d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.462918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ddb42954-4d72-4333-923d-ee6251c184d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.463407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ddb42954-4d72-4333-923d-ee6251c184d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.463823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ddb42954-4d72-4333-923d-ee6251c184d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.467746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:15.495290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ddb42954-4d72-4333-923d-ee6251c184d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047878 Aug 29 22:52:15.495768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 699/1395] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:15.698692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-247d2311-887d-41d0-bd0a-480101fc114b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:15.700867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-247d2311-887d-41d0-bd0a-480101fc114b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:15.707346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-247d2311-887d-41d0-bd0a-480101fc114b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.707841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-247d2311-887d-41d0-bd0a-480101fc114b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.708353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-247d2311-887d-41d0-bd0a-480101fc114b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.709057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-247d2311-887d-41d0-bd0a-480101fc114b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.709517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-247d2311-887d-41d0-bd0a-480101fc114b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.709943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-247d2311-887d-41d0-bd0a-480101fc114b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.741445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-247d2311-887d-41d0-bd0a-480101fc114b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Aug 29 22:52:15.742010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 697/1396] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:15.914319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8a4d5ce4-6b03-4589-8cb2-29040e2fd432 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:15.916508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8a4d5ce4-6b03-4589-8cb2-29040e2fd432 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:15.923666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a4d5ce4-6b03-4589-8cb2-29040e2fd432 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.924194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a4d5ce4-6b03-4589-8cb2-29040e2fd432 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.924609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a4d5ce4-6b03-4589-8cb2-29040e2fd432 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.925984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a4d5ce4-6b03-4589-8cb2-29040e2fd432 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.926902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a4d5ce4-6b03-4589-8cb2-29040e2fd432 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.927127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a4d5ce4-6b03-4589-8cb2-29040e2fd432 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.958098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8a4d5ce4-6b03-4589-8cb2-29040e2fd432 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049154 Aug 29 22:52:15.958678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 700/1397] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:16.340676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.341324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.343677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:52:16.343843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 22:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 (ip 10.222.0.59) !!! Aug 29 22:52:16.356409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.356898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.357342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.358049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.358505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.358936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.426945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:16.436358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-31d53125-980b-4d33-9b1d-9680aec00cec tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.099559 Aug 29 22:52:16.436942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 698/1398] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:16.508296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bc88b2ea-6101-4840-98ae-9617efed2c3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.510462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bc88b2ea-6101-4840-98ae-9617efed2c3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.516781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc88b2ea-6101-4840-98ae-9617efed2c3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.517261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc88b2ea-6101-4840-98ae-9617efed2c3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.517698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc88b2ea-6101-4840-98ae-9617efed2c3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.518395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc88b2ea-6101-4840-98ae-9617efed2c3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.519504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc88b2ea-6101-4840-98ae-9617efed2c3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.520160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc88b2ea-6101-4840-98ae-9617efed2c3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.552770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bc88b2ea-6101-4840-98ae-9617efed2c3b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048460 Aug 29 22:52:16.553365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 701/1399] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:16.754521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f960f6db-e2c8-4749-9505-69e82c273d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.756724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f960f6db-e2c8-4749-9505-69e82c273d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.762731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f960f6db-e2c8-4749-9505-69e82c273d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.763211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f960f6db-e2c8-4749-9505-69e82c273d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.763642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f960f6db-e2c8-4749-9505-69e82c273d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.764377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f960f6db-e2c8-4749-9505-69e82c273d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.764835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f960f6db-e2c8-4749-9505-69e82c273d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.765257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f960f6db-e2c8-4749-9505-69e82c273d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.797252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f960f6db-e2c8-4749-9505-69e82c273d7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Aug 29 22:52:16.797902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 699/1400] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:16.970444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c81d31f1-a8a2-4007-bdb2-d1b59741db77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.973325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c81d31f1-a8a2-4007-bdb2-d1b59741db77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.980120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c81d31f1-a8a2-4007-bdb2-d1b59741db77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.980640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c81d31f1-a8a2-4007-bdb2-d1b59741db77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.981069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c81d31f1-a8a2-4007-bdb2-d1b59741db77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.981762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c81d31f1-a8a2-4007-bdb2-d1b59741db77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.982207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c81d31f1-a8a2-4007-bdb2-d1b59741db77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.982634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c81d31f1-a8a2-4007-bdb2-d1b59741db77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.014745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c81d31f1-a8a2-4007-bdb2-d1b59741db77 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Aug 29 22:52:17.015239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 702/1401] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:17.459114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:17.459740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:17.467541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.468037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.468504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.469215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.469681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.470111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.537421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:17.545428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dbccbe4f-19b4-4df8-9339-a31518e0aa72 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091821 Aug 29 22:52:17.545993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 700/1402] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:17 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:17.566196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5c185c75-6684-4249-b08c-c59b07856320 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:17.568920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5c185c75-6684-4249-b08c-c59b07856320 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:17.575106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c185c75-6684-4249-b08c-c59b07856320 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.575610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c185c75-6684-4249-b08c-c59b07856320 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.576219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c185c75-6684-4249-b08c-c59b07856320 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.576967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c185c75-6684-4249-b08c-c59b07856320 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.577412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c185c75-6684-4249-b08c-c59b07856320 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.577827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c185c75-6684-4249-b08c-c59b07856320 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.610694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5c185c75-6684-4249-b08c-c59b07856320 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049242 Aug 29 22:52:17.611279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 703/1403] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:17.815027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-124bc1fc-22dd-45f4-8750-0d3f4b170faa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:17.819649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-124bc1fc-22dd-45f4-8750-0d3f4b170faa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:17.828431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-124bc1fc-22dd-45f4-8750-0d3f4b170faa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.828930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-124bc1fc-22dd-45f4-8750-0d3f4b170faa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.829373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-124bc1fc-22dd-45f4-8750-0d3f4b170faa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.830419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-124bc1fc-22dd-45f4-8750-0d3f4b170faa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.833373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-124bc1fc-22dd-45f4-8750-0d3f4b170faa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.833373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-124bc1fc-22dd-45f4-8750-0d3f4b170faa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.861432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-124bc1fc-22dd-45f4-8750-0d3f4b170faa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054122 Aug 29 22:52:17.861997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 701/1404] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:18.027756 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-69bee6f9-8a24-4c9e-a716-cecb8d172343 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:18.029930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-69bee6f9-8a24-4c9e-a716-cecb8d172343 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:18.037215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69bee6f9-8a24-4c9e-a716-cecb8d172343 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.037701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69bee6f9-8a24-4c9e-a716-cecb8d172343 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.038118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69bee6f9-8a24-4c9e-a716-cecb8d172343 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.038811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69bee6f9-8a24-4c9e-a716-cecb8d172343 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.039700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69bee6f9-8a24-4c9e-a716-cecb8d172343 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.039700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69bee6f9-8a24-4c9e-a716-cecb8d172343 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.069897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-69bee6f9-8a24-4c9e-a716-cecb8d172343 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045943 Aug 29 22:52:18.070379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 704/1405] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:18.567805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:18.568454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:18.574840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.575310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.575741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.576451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.576899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.577313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.623537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8412c2a8-31f0-4d7f-b6c0-c8b6f066e73d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:18.625706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8412c2a8-31f0-4d7f-b6c0-c8b6f066e73d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:18.632867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8412c2a8-31f0-4d7f-b6c0-c8b6f066e73d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.633343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8412c2a8-31f0-4d7f-b6c0-c8b6f066e73d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.633775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8412c2a8-31f0-4d7f-b6c0-c8b6f066e73d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.634475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8412c2a8-31f0-4d7f-b6c0-c8b6f066e73d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.634923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8412c2a8-31f0-4d7f-b6c0-c8b6f066e73d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.635352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8412c2a8-31f0-4d7f-b6c0-c8b6f066e73d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.642983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:18.651328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-35c9a6b0-b1fb-496d-9948-e02ea971e3fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088092 Aug 29 22:52:18.652006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 702/1406] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:18 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:18.666663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8412c2a8-31f0-4d7f-b6c0-c8b6f066e73d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047383 Aug 29 22:52:18.667231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 705/1407] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:52:18.874842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-00da5ddb-12e2-494c-9c9c-efe42d00811a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:18.876944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-00da5ddb-12e2-494c-9c9c-efe42d00811a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:18.883570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00da5ddb-12e2-494c-9c9c-efe42d00811a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.884054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00da5ddb-12e2-494c-9c9c-efe42d00811a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.884540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00da5ddb-12e2-494c-9c9c-efe42d00811a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.885216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00da5ddb-12e2-494c-9c9c-efe42d00811a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.885665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00da5ddb-12e2-494c-9c9c-efe42d00811a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.886085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00da5ddb-12e2-494c-9c9c-efe42d00811a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.918332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-00da5ddb-12e2-494c-9c9c-efe42d00811a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047440 Aug 29 22:52:18.919236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 703/1408] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:19.083037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-28327538-1bbf-417c-91d9-923c777d3a1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:19.085222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-28327538-1bbf-417c-91d9-923c777d3a1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:19.091654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28327538-1bbf-417c-91d9-923c777d3a1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.092193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28327538-1bbf-417c-91d9-923c777d3a1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.092627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28327538-1bbf-417c-91d9-923c777d3a1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.093311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28327538-1bbf-417c-91d9-923c777d3a1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.093757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28327538-1bbf-417c-91d9-923c777d3a1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.094171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28327538-1bbf-417c-91d9-923c777d3a1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.125185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-28327538-1bbf-417c-91d9-923c777d3a1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046443 Aug 29 22:52:19.125682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 706/1409] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:19.672462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:19.673082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:19.680276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.680922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.681052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9f7dd2be-82ee-4f01-9c01-a3bf89fe9217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:19.681269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.681929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.682384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.682816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.683205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9f7dd2be-82ee-4f01-9c01-a3bf89fe9217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:19.689832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f7dd2be-82ee-4f01-9c01-a3bf89fe9217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.690305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f7dd2be-82ee-4f01-9c01-a3bf89fe9217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.691691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f7dd2be-82ee-4f01-9c01-a3bf89fe9217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.692502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f7dd2be-82ee-4f01-9c01-a3bf89fe9217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.693177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f7dd2be-82ee-4f01-9c01-a3bf89fe9217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.693601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f7dd2be-82ee-4f01-9c01-a3bf89fe9217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.700306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:19.739117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9f7dd2be-82ee-4f01-9c01-a3bf89fe9217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062114 Aug 29 22:52:19.739705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 707/1410] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:52:19.754769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:19.762752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f6106a29-396e-436f-900e-1c210e4ef8ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094166 Aug 29 22:52:19.763323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 704/1411] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:19 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:19.932517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e0359364-21e5-43ca-9e78-b5531e21457d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:19.934744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e0359364-21e5-43ca-9e78-b5531e21457d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:19.941621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0359364-21e5-43ca-9e78-b5531e21457d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.942261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0359364-21e5-43ca-9e78-b5531e21457d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.942699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0359364-21e5-43ca-9e78-b5531e21457d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.943401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0359364-21e5-43ca-9e78-b5531e21457d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.943853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0359364-21e5-43ca-9e78-b5531e21457d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.944308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0359364-21e5-43ca-9e78-b5531e21457d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.975021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e0359364-21e5-43ca-9e78-b5531e21457d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 Aug 29 22:52:19.975610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 708/1412] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:20.137600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-86a19f03-d0d7-4dea-b861-f5d092603766 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:20.139748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-86a19f03-d0d7-4dea-b861-f5d092603766 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:20.146266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a19f03-d0d7-4dea-b861-f5d092603766 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.146751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a19f03-d0d7-4dea-b861-f5d092603766 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.147189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a19f03-d0d7-4dea-b861-f5d092603766 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.147895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a19f03-d0d7-4dea-b861-f5d092603766 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.148371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a19f03-d0d7-4dea-b861-f5d092603766 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.148797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a19f03-d0d7-4dea-b861-f5d092603766 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.183209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-86a19f03-d0d7-4dea-b861-f5d092603766 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049377 Aug 29 22:52:20.183895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 705/1413] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:20.752183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-314822e8-d2b6-40c1-a3b7-6b1795cc60d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:20.755364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-314822e8-d2b6-40c1-a3b7-6b1795cc60d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:20.761903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-314822e8-d2b6-40c1-a3b7-6b1795cc60d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.762379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-314822e8-d2b6-40c1-a3b7-6b1795cc60d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.762810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-314822e8-d2b6-40c1-a3b7-6b1795cc60d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.763498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-314822e8-d2b6-40c1-a3b7-6b1795cc60d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.763948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-314822e8-d2b6-40c1-a3b7-6b1795cc60d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.764398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-314822e8-d2b6-40c1-a3b7-6b1795cc60d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.785394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:20.786244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:20.792759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.793243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.793680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.794381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.794834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.795255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.795372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-314822e8-d2b6-40c1-a3b7-6b1795cc60d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047171 Aug 29 22:52:20.795867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 709/1414] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:20.860857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:20.869496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-32d4f7d2-296f-4697-98e8-22b2fc26bb4b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088605 Aug 29 22:52:20.871588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 706/1415] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:20 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:20.988361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2c41c08a-c070-4831-9876-f8301dab2074 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:20.990498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2c41c08a-c070-4831-9876-f8301dab2074 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:20.996423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c41c08a-c070-4831-9876-f8301dab2074 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.996899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c41c08a-c070-4831-9876-f8301dab2074 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.997411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c41c08a-c070-4831-9876-f8301dab2074 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.998579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c41c08a-c070-4831-9876-f8301dab2074 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.999025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c41c08a-c070-4831-9876-f8301dab2074 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.999442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c41c08a-c070-4831-9876-f8301dab2074 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.030671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2c41c08a-c070-4831-9876-f8301dab2074 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046865 Aug 29 22:52:21.031121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 710/1416] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:21.195253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8b1cbf6b-dbe7-46a3-be97-3bf205d7c706 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:21.197442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8b1cbf6b-dbe7-46a3-be97-3bf205d7c706 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:21.203470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b1cbf6b-dbe7-46a3-be97-3bf205d7c706 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.203947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b1cbf6b-dbe7-46a3-be97-3bf205d7c706 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.204418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b1cbf6b-dbe7-46a3-be97-3bf205d7c706 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.205364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b1cbf6b-dbe7-46a3-be97-3bf205d7c706 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.205805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b1cbf6b-dbe7-46a3-be97-3bf205d7c706 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.206229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b1cbf6b-dbe7-46a3-be97-3bf205d7c706 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.236329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8b1cbf6b-dbe7-46a3-be97-3bf205d7c706 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Aug 29 22:52:21.236896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 707/1417] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:21.808976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0e80766e-f7de-414e-ae98-1993f1f9602a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:21.811275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0e80766e-f7de-414e-ae98-1993f1f9602a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:21.817816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e80766e-f7de-414e-ae98-1993f1f9602a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.818301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e80766e-f7de-414e-ae98-1993f1f9602a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.818739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e80766e-f7de-414e-ae98-1993f1f9602a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.819434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e80766e-f7de-414e-ae98-1993f1f9602a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.819888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e80766e-f7de-414e-ae98-1993f1f9602a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.820344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e80766e-f7de-414e-ae98-1993f1f9602a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.854060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0e80766e-f7de-414e-ae98-1993f1f9602a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049165 Aug 29 22:52:21.854628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 711/1418] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:21.891139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:21.891786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:21.898860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.899343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.899777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.900498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.900956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.901377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.966011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:21.974328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-69906b70-0595-43db-8c7b-30c3cd7562f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087068 Aug 29 22:52:21.974896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 708/1419] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:21 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:22.043275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2b4a438e-6384-4499-a4ca-f21542eec93f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:22.045508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2b4a438e-6384-4499-a4ca-f21542eec93f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:22.052434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b4a438e-6384-4499-a4ca-f21542eec93f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.053175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b4a438e-6384-4499-a4ca-f21542eec93f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.053318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b4a438e-6384-4499-a4ca-f21542eec93f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.054016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b4a438e-6384-4499-a4ca-f21542eec93f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.054468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b4a438e-6384-4499-a4ca-f21542eec93f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.054892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b4a438e-6384-4499-a4ca-f21542eec93f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.085399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2b4a438e-6384-4499-a4ca-f21542eec93f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046084 Aug 29 22:52:22.086155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 712/1420] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:22.253685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-13304089-47c4-42df-b545-1bb88c33cdeb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:22.255847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-13304089-47c4-42df-b545-1bb88c33cdeb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:22.267040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13304089-47c4-42df-b545-1bb88c33cdeb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.267534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13304089-47c4-42df-b545-1bb88c33cdeb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.267969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13304089-47c4-42df-b545-1bb88c33cdeb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.269232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13304089-47c4-42df-b545-1bb88c33cdeb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.269726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13304089-47c4-42df-b545-1bb88c33cdeb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.270147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13304089-47c4-42df-b545-1bb88c33cdeb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.304086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-13304089-47c4-42df-b545-1bb88c33cdeb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058362 Aug 29 22:52:22.304785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 709/1421] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:22.867559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-006895f3-4fdb-49a4-91fb-39473f716cee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:22.869800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-006895f3-4fdb-49a4-91fb-39473f716cee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:22.871805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:52:22.871966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 22:52:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments (ip 10.222.0.59) !!! Aug 29 22:52:22.878888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006895f3-4fdb-49a4-91fb-39473f716cee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.879352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006895f3-4fdb-49a4-91fb-39473f716cee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.879776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006895f3-4fdb-49a4-91fb-39473f716cee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.880522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006895f3-4fdb-49a4-91fb-39473f716cee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.881237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006895f3-4fdb-49a4-91fb-39473f716cee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.881409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-006895f3-4fdb-49a4-91fb-39473f716cee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.915327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-006895f3-4fdb-49a4-91fb-39473f716cee tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051839 Aug 29 22:52:22.915906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 713/1422] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:22.995137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:22.995762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:23.002069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.002552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.003025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.003801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.004527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.005074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.079306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:23.089315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e8cbe037-52e5-45be-94e8-e8723f6597cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.098191 Aug 29 22:52:23.089955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 710/1423] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:22 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:23.099121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-18eea3f8-742b-4661-983d-1b22e9d920b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:23.101575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-18eea3f8-742b-4661-983d-1b22e9d920b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:23.107965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eea3f8-742b-4661-983d-1b22e9d920b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.108493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eea3f8-742b-4661-983d-1b22e9d920b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.108937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eea3f8-742b-4661-983d-1b22e9d920b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.109659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eea3f8-742b-4661-983d-1b22e9d920b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.110247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eea3f8-742b-4661-983d-1b22e9d920b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.110543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eea3f8-742b-4661-983d-1b22e9d920b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.146232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-18eea3f8-742b-4661-983d-1b22e9d920b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052263 Aug 29 22:52:23.146874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 714/1424] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:23.317782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0157dbb8-2d11-47c3-a369-d991b8245a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:23.320156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0157dbb8-2d11-47c3-a369-d991b8245a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:23.326148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0157dbb8-2d11-47c3-a369-d991b8245a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.326638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0157dbb8-2d11-47c3-a369-d991b8245a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.327068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0157dbb8-2d11-47c3-a369-d991b8245a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.327760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0157dbb8-2d11-47c3-a369-d991b8245a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.328240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0157dbb8-2d11-47c3-a369-d991b8245a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.328665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0157dbb8-2d11-47c3-a369-d991b8245a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.360251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0157dbb8-2d11-47c3-a369-d991b8245a85 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047042 Aug 29 22:52:23.360838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 711/1425] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:23.928760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-529a7f86-0441-459d-95fd-17289638856c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:23.931057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-529a7f86-0441-459d-95fd-17289638856c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:23.933474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:23.938212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-529a7f86-0441-459d-95fd-17289638856c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.944032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-529a7f86-0441-459d-95fd-17289638856c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.944032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-529a7f86-0441-459d-95fd-17289638856c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.944032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-529a7f86-0441-459d-95fd-17289638856c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.944032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-529a7f86-0441-459d-95fd-17289638856c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.944611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-529a7f86-0441-459d-95fd-17289638856c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.969205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:23.974928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-529a7f86-0441-459d-95fd-17289638856c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050781 Aug 29 22:52:23.978425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 715/1426] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:24.111238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:24.111782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:24.118395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.118876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.119314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.120006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.120490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.120914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.159900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-86c7c740-f2bd-41e8-912b-5424744a5d05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:24.162077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-86c7c740-f2bd-41e8-912b-5424744a5d05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:24.168474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86c7c740-f2bd-41e8-912b-5424744a5d05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.168958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86c7c740-f2bd-41e8-912b-5424744a5d05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.169393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86c7c740-f2bd-41e8-912b-5424744a5d05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.170103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86c7c740-f2bd-41e8-912b-5424744a5d05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.170552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86c7c740-f2bd-41e8-912b-5424744a5d05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.170978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86c7c740-f2bd-41e8-912b-5424744a5d05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.185923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:24.194252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e59e799b-6c81-416f-b8b7-b124361ea84e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087059 Aug 29 22:52:24.194834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 712/1427] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:24 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:24.205480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-86c7c740-f2bd-41e8-912b-5424744a5d05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050308 Aug 29 22:52:24.206082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 716/1428] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:24.372698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-756f31e8-7778-4ac4-8329-5bf21d899e37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:24.374936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-756f31e8-7778-4ac4-8329-5bf21d899e37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:24.382357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756f31e8-7778-4ac4-8329-5bf21d899e37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.382851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756f31e8-7778-4ac4-8329-5bf21d899e37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.383294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756f31e8-7778-4ac4-8329-5bf21d899e37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.384036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756f31e8-7778-4ac4-8329-5bf21d899e37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.384545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756f31e8-7778-4ac4-8329-5bf21d899e37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.384929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756f31e8-7778-4ac4-8329-5bf21d899e37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.417850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-756f31e8-7778-4ac4-8329-5bf21d899e37 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049082 Aug 29 22:52:24.418424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 713/1429] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:24.988069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e1506fa9-795f-498e-8e89-21e0a153dbce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:24.989740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e1506fa9-795f-498e-8e89-21e0a153dbce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:24.996459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1506fa9-795f-498e-8e89-21e0a153dbce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.996943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1506fa9-795f-498e-8e89-21e0a153dbce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.997374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1506fa9-795f-498e-8e89-21e0a153dbce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.998072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1506fa9-795f-498e-8e89-21e0a153dbce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.998522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1506fa9-795f-498e-8e89-21e0a153dbce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.999017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1506fa9-795f-498e-8e89-21e0a153dbce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.031162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e1506fa9-795f-498e-8e89-21e0a153dbce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047789 Aug 29 22:52:25.031730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 717/1430] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:25.216696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:25.217350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:25.218059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ba1dc62c-dc79-494a-86a9-fd1b994f3009 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:25.220224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ba1dc62c-dc79-494a-86a9-fd1b994f3009 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:25.224065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:25.224688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:25.225134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.225834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:25.226282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:25.226591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba1dc62c-dc79-494a-86a9-fd1b994f3009 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:25.226766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.227012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba1dc62c-dc79-494a-86a9-fd1b994f3009 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:25.227309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba1dc62c-dc79-494a-86a9-fd1b994f3009 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.228068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba1dc62c-dc79-494a-86a9-fd1b994f3009 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:25.228551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba1dc62c-dc79-494a-86a9-fd1b994f3009 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:25.228963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba1dc62c-dc79-494a-86a9-fd1b994f3009 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.262165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ba1dc62c-dc79-494a-86a9-fd1b994f3009 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047934 Aug 29 22:52:25.262691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 718/1431] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:25.289985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:25.297775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-819a6aec-1bcd-449c-bc61-7bdf3e1f955d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085448 Aug 29 22:52:25.298341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 714/1432] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:25.430986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2c586a2e-e65e-4be8-a501-b82f143f703c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:25.433187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2c586a2e-e65e-4be8-a501-b82f143f703c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:25.439343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c586a2e-e65e-4be8-a501-b82f143f703c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:25.439818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c586a2e-e65e-4be8-a501-b82f143f703c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:25.440407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c586a2e-e65e-4be8-a501-b82f143f703c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.441659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c586a2e-e65e-4be8-a501-b82f143f703c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:25.442270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c586a2e-e65e-4be8-a501-b82f143f703c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:25.442687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c586a2e-e65e-4be8-a501-b82f143f703c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:25.474369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2c586a2e-e65e-4be8-a501-b82f143f703c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047324 Aug 29 22:52:25.474939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 719/1433] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:26.045174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4582caa1-955f-48fc-b48b-e1a422d906c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:26.047434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4582caa1-955f-48fc-b48b-e1a422d906c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:26.050166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:52:26.050350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 22:52:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments (ip 10.222.0.59) !!! Aug 29 22:52:26.057068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4582caa1-955f-48fc-b48b-e1a422d906c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.057434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4582caa1-955f-48fc-b48b-e1a422d906c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.057872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4582caa1-955f-48fc-b48b-e1a422d906c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.058581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4582caa1-955f-48fc-b48b-e1a422d906c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.059026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4582caa1-955f-48fc-b48b-e1a422d906c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.059442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4582caa1-955f-48fc-b48b-e1a422d906c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.113903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4582caa1-955f-48fc-b48b-e1a422d906c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071307 Aug 29 22:52:26.114899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 715/1434] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:26.275582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7a694b7f-986b-4fc1-88c0-dc939560f098 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:26.278095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7a694b7f-986b-4fc1-88c0-dc939560f098 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:26.286332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a694b7f-986b-4fc1-88c0-dc939560f098 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.286907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a694b7f-986b-4fc1-88c0-dc939560f098 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.287245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a694b7f-986b-4fc1-88c0-dc939560f098 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.287963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a694b7f-986b-4fc1-88c0-dc939560f098 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.288525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a694b7f-986b-4fc1-88c0-dc939560f098 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.288951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a694b7f-986b-4fc1-88c0-dc939560f098 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.318729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:26.319266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:26.326465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.327032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.327521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.328393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.328849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.329267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.340176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7a694b7f-986b-4fc1-88c0-dc939560f098 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068599 Aug 29 22:52:26.340843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 720/1435] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:26.402805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:26.411912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-25849dfe-bd1c-405b-b294-c59a8305cc29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.097617 Aug 29 22:52:26.412516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 716/1436] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:26.485984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c9580fb3-f03f-4488-bf58-a8c1e2285788 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:26.488333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c9580fb3-f03f-4488-bf58-a8c1e2285788 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:26.494419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9580fb3-f03f-4488-bf58-a8c1e2285788 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.495588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9580fb3-f03f-4488-bf58-a8c1e2285788 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.496022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9580fb3-f03f-4488-bf58-a8c1e2285788 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.496754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9580fb3-f03f-4488-bf58-a8c1e2285788 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.497213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9580fb3-f03f-4488-bf58-a8c1e2285788 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.497632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9580fb3-f03f-4488-bf58-a8c1e2285788 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.531035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c9580fb3-f03f-4488-bf58-a8c1e2285788 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048932 Aug 29 22:52:26.531631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 721/1437] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:27.127131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-668df056-7218-4b5c-8f2b-2fb0e7245ef2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:27.129537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-668df056-7218-4b5c-8f2b-2fb0e7245ef2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:27.136092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668df056-7218-4b5c-8f2b-2fb0e7245ef2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.139441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668df056-7218-4b5c-8f2b-2fb0e7245ef2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.139441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668df056-7218-4b5c-8f2b-2fb0e7245ef2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.139441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668df056-7218-4b5c-8f2b-2fb0e7245ef2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.139441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668df056-7218-4b5c-8f2b-2fb0e7245ef2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.139825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-668df056-7218-4b5c-8f2b-2fb0e7245ef2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.169983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-668df056-7218-4b5c-8f2b-2fb0e7245ef2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046912 Aug 29 22:52:27.170552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 717/1438] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:27.353946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6fb8dcfc-b547-47fc-b230-19d96df19a93 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:27.356010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6fb8dcfc-b547-47fc-b230-19d96df19a93 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:27.358251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:52:27.365543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 22:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments (ip 10.222.0.59) !!! Aug 29 22:52:27.365543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fb8dcfc-b547-47fc-b230-19d96df19a93 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.365543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fb8dcfc-b547-47fc-b230-19d96df19a93 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.365938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fb8dcfc-b547-47fc-b230-19d96df19a93 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.366673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fb8dcfc-b547-47fc-b230-19d96df19a93 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.367121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fb8dcfc-b547-47fc-b230-19d96df19a93 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.367541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fb8dcfc-b547-47fc-b230-19d96df19a93 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.402812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6fb8dcfc-b547-47fc-b230-19d96df19a93 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052872 Aug 29 22:52:27.403399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 722/1439] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:27 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:27.433727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:27.434384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:27.441844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.442325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.442753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.443451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.443899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.444354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.509941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:27.517821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-19c80e1e-68b6-4b5f-a4c5-0e8d440056f7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088353 Aug 29 22:52:27.519170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 718/1440] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:27 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:27.543695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f80aa5c4-3e79-477b-aae0-72be5520ce68 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:27.545829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f80aa5c4-3e79-477b-aae0-72be5520ce68 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:27.552267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f80aa5c4-3e79-477b-aae0-72be5520ce68 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.552744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f80aa5c4-3e79-477b-aae0-72be5520ce68 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.553172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f80aa5c4-3e79-477b-aae0-72be5520ce68 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.553859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f80aa5c4-3e79-477b-aae0-72be5520ce68 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.554304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f80aa5c4-3e79-477b-aae0-72be5520ce68 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.554718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f80aa5c4-3e79-477b-aae0-72be5520ce68 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.585767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f80aa5c4-3e79-477b-aae0-72be5520ce68 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045955 Aug 29 22:52:27.586336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 723/1441] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:28.183446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8659fae6-8f70-4dd8-9938-7b22e45369f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:28.185662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8659fae6-8f70-4dd8-9938-7b22e45369f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:28.192279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8659fae6-8f70-4dd8-9938-7b22e45369f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.192759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8659fae6-8f70-4dd8-9938-7b22e45369f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.193244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8659fae6-8f70-4dd8-9938-7b22e45369f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.193879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8659fae6-8f70-4dd8-9938-7b22e45369f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.194329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8659fae6-8f70-4dd8-9938-7b22e45369f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.194745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8659fae6-8f70-4dd8-9938-7b22e45369f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.226044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8659fae6-8f70-4dd8-9938-7b22e45369f2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046572 Aug 29 22:52:28.226671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 719/1442] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:28.415928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9978397d-d179-48d7-a269-d2d339664194 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:28.418139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9978397d-d179-48d7-a269-d2d339664194 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:28.426037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9978397d-d179-48d7-a269-d2d339664194 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.426325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9978397d-d179-48d7-a269-d2d339664194 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.426664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9978397d-d179-48d7-a269-d2d339664194 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.427437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9978397d-d179-48d7-a269-d2d339664194 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.427884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9978397d-d179-48d7-a269-d2d339664194 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.428340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9978397d-d179-48d7-a269-d2d339664194 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.460499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9978397d-d179-48d7-a269-d2d339664194 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048520 Aug 29 22:52:28.461016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 724/1443] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:28.540220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:28.540831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:28.547493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.547977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.548469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.549162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.549844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.550049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.598784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-21508a1a-f595-4fc9-a95d-2e9bb818ec46 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:28.601092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-21508a1a-f595-4fc9-a95d-2e9bb818ec46 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:28.607571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21508a1a-f595-4fc9-a95d-2e9bb818ec46 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.608088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21508a1a-f595-4fc9-a95d-2e9bb818ec46 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.608540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21508a1a-f595-4fc9-a95d-2e9bb818ec46 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.609268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21508a1a-f595-4fc9-a95d-2e9bb818ec46 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.609710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21508a1a-f595-4fc9-a95d-2e9bb818ec46 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.610128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21508a1a-f595-4fc9-a95d-2e9bb818ec46 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.616405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:28.624671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5024d976-8c82-47d4-b8f3-b34fac0c3cdb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088406 Aug 29 22:52:28.625264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 720/1444] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:28 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:28.647778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-21508a1a-f595-4fc9-a95d-2e9bb818ec46 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053307 Aug 29 22:52:28.648371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 725/1445] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:29.240413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1d3b071d-ad52-464a-bea5-bce376ac2b59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:29.242516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1d3b071d-ad52-464a-bea5-bce376ac2b59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:29.248938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3b071d-ad52-464a-bea5-bce376ac2b59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.249438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3b071d-ad52-464a-bea5-bce376ac2b59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.249964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3b071d-ad52-464a-bea5-bce376ac2b59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.250606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3b071d-ad52-464a-bea5-bce376ac2b59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.251076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3b071d-ad52-464a-bea5-bce376ac2b59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.251503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d3b071d-ad52-464a-bea5-bce376ac2b59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.255539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:29.287776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1d3b071d-ad52-464a-bea5-bce376ac2b59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052492 Aug 29 22:52:29.288404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 721/1446] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:29.472928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f01a08fc-a130-452c-92cb-7109b8efc891 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:29.475092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f01a08fc-a130-452c-92cb-7109b8efc891 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:29.481611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f01a08fc-a130-452c-92cb-7109b8efc891 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.482083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f01a08fc-a130-452c-92cb-7109b8efc891 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.482509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f01a08fc-a130-452c-92cb-7109b8efc891 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.483195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f01a08fc-a130-452c-92cb-7109b8efc891 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.483639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f01a08fc-a130-452c-92cb-7109b8efc891 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.484053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f01a08fc-a130-452c-92cb-7109b8efc891 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.514415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f01a08fc-a130-452c-92cb-7109b8efc891 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Aug 29 22:52:29.514885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 726/1447] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:29.649826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:29.650435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:29.653089 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:29.658124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.658613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.659923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.660073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f6e57cea-14db-4fe0-80be-64282e33fedf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:29.660847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.661471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.661913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.662331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f6e57cea-14db-4fe0-80be-64282e33fedf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:29.668425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6e57cea-14db-4fe0-80be-64282e33fedf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.675808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6e57cea-14db-4fe0-80be-64282e33fedf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.675808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6e57cea-14db-4fe0-80be-64282e33fedf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.675808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6e57cea-14db-4fe0-80be-64282e33fedf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.675808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6e57cea-14db-4fe0-80be-64282e33fedf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.677400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6e57cea-14db-4fe0-80be-64282e33fedf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.706406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f6e57cea-14db-4fe0-80be-64282e33fedf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050657 Aug 29 22:52:29.707263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 727/1448] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:29.731344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:29.739739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-61754d2d-5a2c-4249-9c44-8e1ca379ac02 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093694 Aug 29 22:52:29.740708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 722/1449] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:29 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:30.299407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7700c975-22da-4c43-87ef-094a17268ac7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:30.301985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7700c975-22da-4c43-87ef-094a17268ac7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:30.308319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7700c975-22da-4c43-87ef-094a17268ac7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.308799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7700c975-22da-4c43-87ef-094a17268ac7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.309232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7700c975-22da-4c43-87ef-094a17268ac7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.309927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7700c975-22da-4c43-87ef-094a17268ac7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.310371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7700c975-22da-4c43-87ef-094a17268ac7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.310788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7700c975-22da-4c43-87ef-094a17268ac7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.342456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7700c975-22da-4c43-87ef-094a17268ac7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047034 Aug 29 22:52:30.343011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 728/1450] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:30.527513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d8e2c47f-1e89-4e20-ac4c-4c66985054bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:30.529761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d8e2c47f-1e89-4e20-ac4c-4c66985054bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:30.536162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8e2c47f-1e89-4e20-ac4c-4c66985054bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.536624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8e2c47f-1e89-4e20-ac4c-4c66985054bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.537064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8e2c47f-1e89-4e20-ac4c-4c66985054bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.537779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8e2c47f-1e89-4e20-ac4c-4c66985054bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.538236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8e2c47f-1e89-4e20-ac4c-4c66985054bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.538663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8e2c47f-1e89-4e20-ac4c-4c66985054bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.570413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d8e2c47f-1e89-4e20-ac4c-4c66985054bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046732 Aug 29 22:52:30.570959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 723/1451] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:30.718933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ccb229f6-ba18-4930-a7d3-a7f2d5786fc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:30.721161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ccb229f6-ba18-4930-a7d3-a7f2d5786fc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:30.728168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccb229f6-ba18-4930-a7d3-a7f2d5786fc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.728364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccb229f6-ba18-4930-a7d3-a7f2d5786fc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.728772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccb229f6-ba18-4930-a7d3-a7f2d5786fc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.729471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccb229f6-ba18-4930-a7d3-a7f2d5786fc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.729918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccb229f6-ba18-4930-a7d3-a7f2d5786fc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.730338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccb229f6-ba18-4930-a7d3-a7f2d5786fc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.760305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:30.760952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:30.762135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ccb229f6-ba18-4930-a7d3-a7f2d5786fc2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047159 Aug 29 22:52:30.762713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 729/1452] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:30.767426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.767914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.768454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.769167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.769614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.770039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.836799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:30.844988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1142c669-c324-4ee8-affe-ed698b63c9e4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088491 Aug 29 22:52:30.845564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 724/1453] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:30 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:31.355430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-209ee69f-7969-4509-a5a8-ed7e0709bd7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:31.357682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-209ee69f-7969-4509-a5a8-ed7e0709bd7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:31.364092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-209ee69f-7969-4509-a5a8-ed7e0709bd7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.364618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-209ee69f-7969-4509-a5a8-ed7e0709bd7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.365051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-209ee69f-7969-4509-a5a8-ed7e0709bd7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.365842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-209ee69f-7969-4509-a5a8-ed7e0709bd7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.366295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-209ee69f-7969-4509-a5a8-ed7e0709bd7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.366713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-209ee69f-7969-4509-a5a8-ed7e0709bd7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.398271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-209ee69f-7969-4509-a5a8-ed7e0709bd7c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046993 Aug 29 22:52:31.399256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 730/1454] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:31.584013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c81874c5-3e01-4525-845c-09c000b01765 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:31.586245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c81874c5-3e01-4525-845c-09c000b01765 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:31.592309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c81874c5-3e01-4525-845c-09c000b01765 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.592795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c81874c5-3e01-4525-845c-09c000b01765 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.593228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c81874c5-3e01-4525-845c-09c000b01765 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.593927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c81874c5-3e01-4525-845c-09c000b01765 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.594376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c81874c5-3e01-4525-845c-09c000b01765 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.594801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c81874c5-3e01-4525-845c-09c000b01765 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.625027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c81874c5-3e01-4525-845c-09c000b01765 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Aug 29 22:52:31.625603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 725/1455] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:31.775021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-276a27ff-d13f-423a-8fe9-d2ff405df0a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:31.777260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-276a27ff-d13f-423a-8fe9-d2ff405df0a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:31.783724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-276a27ff-d13f-423a-8fe9-d2ff405df0a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.784535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-276a27ff-d13f-423a-8fe9-d2ff405df0a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.784966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-276a27ff-d13f-423a-8fe9-d2ff405df0a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.785661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-276a27ff-d13f-423a-8fe9-d2ff405df0a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.786112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-276a27ff-d13f-423a-8fe9-d2ff405df0a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.786532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-276a27ff-d13f-423a-8fe9-d2ff405df0a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.821088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-276a27ff-d13f-423a-8fe9-d2ff405df0a1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050071 Aug 29 22:52:31.821723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 731/1456] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:31.866956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:31.867666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:31.874443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.874842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.875389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.876095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.876581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.877005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.962165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:31.972798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-226eeb3d-e610-4368-91aa-4aa17bc5c07b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.109914 Aug 29 22:52:31.973393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 726/1457] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:31 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:32.411762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6fcfad67-e9a0-4a18-91c7-dce96c40dc92 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:32.413955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6fcfad67-e9a0-4a18-91c7-dce96c40dc92 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:32.419997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fcfad67-e9a0-4a18-91c7-dce96c40dc92 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:32.420497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fcfad67-e9a0-4a18-91c7-dce96c40dc92 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:32.420922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fcfad67-e9a0-4a18-91c7-dce96c40dc92 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:32.421598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fcfad67-e9a0-4a18-91c7-dce96c40dc92 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:32.422039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fcfad67-e9a0-4a18-91c7-dce96c40dc92 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:32.422457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fcfad67-e9a0-4a18-91c7-dce96c40dc92 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:32.439955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:32.454182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6fcfad67-e9a0-4a18-91c7-dce96c40dc92 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046860 Aug 29 22:52:32.462851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 732/1458] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:32.640179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bf6e3293-1ce4-4f6d-a7c2-33c545234945 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:32.642456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bf6e3293-1ce4-4f6d-a7c2-33c545234945 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:32.649467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf6e3293-1ce4-4f6d-a7c2-33c545234945 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:32.649951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf6e3293-1ce4-4f6d-a7c2-33c545234945 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:32.650412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf6e3293-1ce4-4f6d-a7c2-33c545234945 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:32.651124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf6e3293-1ce4-4f6d-a7c2-33c545234945 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:32.651594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf6e3293-1ce4-4f6d-a7c2-33c545234945 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:32.652014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf6e3293-1ce4-4f6d-a7c2-33c545234945 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:32.685144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bf6e3293-1ce4-4f6d-a7c2-33c545234945 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049001 Aug 29 22:52:32.685640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 727/1459] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:32.834686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-898b9512-00c0-4845-ae10-e0d7ea699d39 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:32.837059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-898b9512-00c0-4845-ae10-e0d7ea699d39 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:32.844760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-898b9512-00c0-4845-ae10-e0d7ea699d39 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:32.845251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-898b9512-00c0-4845-ae10-e0d7ea699d39 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:32.845687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-898b9512-00c0-4845-ae10-e0d7ea699d39 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:32.846414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-898b9512-00c0-4845-ae10-e0d7ea699d39 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:32.846873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-898b9512-00c0-4845-ae10-e0d7ea699d39 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:32.847304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-898b9512-00c0-4845-ae10-e0d7ea699d39 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:32.882869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-898b9512-00c0-4845-ae10-e0d7ea699d39 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052812 Aug 29 22:52:32.883630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 733/1460] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:32.999081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:33.000129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:33.012845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.013734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.014501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.015775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.016657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.017446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.093250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:33.102907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ca7cbc68-84e0-4d3d-a1e1-282a6497ff84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.110981 Aug 29 22:52:33.103506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 728/1461] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:32 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:33.474037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cfa6073e-d58e-41f0-9591-c62db740350b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:33.476229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cfa6073e-d58e-41f0-9591-c62db740350b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:33.482430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfa6073e-d58e-41f0-9591-c62db740350b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.482905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfa6073e-d58e-41f0-9591-c62db740350b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.483333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfa6073e-d58e-41f0-9591-c62db740350b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.484021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfa6073e-d58e-41f0-9591-c62db740350b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.484491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfa6073e-d58e-41f0-9591-c62db740350b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.484914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfa6073e-d58e-41f0-9591-c62db740350b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.521324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cfa6073e-d58e-41f0-9591-c62db740350b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051789 Aug 29 22:52:33.521931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 734/1462] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:52:33.698508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7f67d83f-83fc-4e85-a3b6-172d023aa5b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:33.700739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7f67d83f-83fc-4e85-a3b6-172d023aa5b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:33.708551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7f67d83f-83fc-4e85-a3b6-172d023aa5b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.709038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7f67d83f-83fc-4e85-a3b6-172d023aa5b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.709472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7f67d83f-83fc-4e85-a3b6-172d023aa5b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.710188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7f67d83f-83fc-4e85-a3b6-172d023aa5b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.710636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7f67d83f-83fc-4e85-a3b6-172d023aa5b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.711063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7f67d83f-83fc-4e85-a3b6-172d023aa5b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.746835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7f67d83f-83fc-4e85-a3b6-172d023aa5b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052179 Aug 29 22:52:33.747335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 729/1463] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:33.895988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a367a0f6-85c8-47e2-a99c-9bb152515207 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:33.898208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a367a0f6-85c8-47e2-a99c-9bb152515207 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:33.904940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a367a0f6-85c8-47e2-a99c-9bb152515207 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.905423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a367a0f6-85c8-47e2-a99c-9bb152515207 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.905861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a367a0f6-85c8-47e2-a99c-9bb152515207 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.906566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a367a0f6-85c8-47e2-a99c-9bb152515207 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.907019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a367a0f6-85c8-47e2-a99c-9bb152515207 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.907437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a367a0f6-85c8-47e2-a99c-9bb152515207 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.942533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a367a0f6-85c8-47e2-a99c-9bb152515207 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051252 Aug 29 22:52:33.943123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 735/1464] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:34.125449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:34.126093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:34.133729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.134216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.134654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.135358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.135807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.136257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.225852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:34.234270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-71ea8383-ebb6-49b3-bb35-ef5a913a56ca tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.112939 Aug 29 22:52:34.234851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 730/1465] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:34 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:34.537791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-74879e84-88d0-419b-8972-f23d514b475c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:34.539870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-74879e84-88d0-419b-8972-f23d514b475c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:34.546113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74879e84-88d0-419b-8972-f23d514b475c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.546601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74879e84-88d0-419b-8972-f23d514b475c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.547086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74879e84-88d0-419b-8972-f23d514b475c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.547796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74879e84-88d0-419b-8972-f23d514b475c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.548284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74879e84-88d0-419b-8972-f23d514b475c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.548713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74879e84-88d0-419b-8972-f23d514b475c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.583979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-74879e84-88d0-419b-8972-f23d514b475c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051056 Aug 29 22:52:34.584602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 736/1466] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:52:34.760614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dcdbfae9-b155-494d-8255-7b433e847eb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:34.762895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dcdbfae9-b155-494d-8255-7b433e847eb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:34.769893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcdbfae9-b155-494d-8255-7b433e847eb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.770382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcdbfae9-b155-494d-8255-7b433e847eb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.770933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcdbfae9-b155-494d-8255-7b433e847eb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.771685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcdbfae9-b155-494d-8255-7b433e847eb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.772175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcdbfae9-b155-494d-8255-7b433e847eb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.772589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcdbfae9-b155-494d-8255-7b433e847eb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.811553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dcdbfae9-b155-494d-8255-7b433e847eb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055086 Aug 29 22:52:34.812028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 731/1467] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:34.955354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9db77c4b-38a7-494a-b0e5-269da6aef31c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:34.957637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9db77c4b-38a7-494a-b0e5-269da6aef31c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:34.964403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9db77c4b-38a7-494a-b0e5-269da6aef31c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.964885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9db77c4b-38a7-494a-b0e5-269da6aef31c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.965319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9db77c4b-38a7-494a-b0e5-269da6aef31c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.966021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9db77c4b-38a7-494a-b0e5-269da6aef31c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.966472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9db77c4b-38a7-494a-b0e5-269da6aef31c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.966892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9db77c4b-38a7-494a-b0e5-269da6aef31c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.999392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9db77c4b-38a7-494a-b0e5-269da6aef31c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048259 Aug 29 22:52:34.999972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 737/1468] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:35.256448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:35.257101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:35.263554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.264030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.264488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.265177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.265626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.266049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.331978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:35.340391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-97455f32-cdcf-4b0b-8ac8-e402063cb16c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087946 Aug 29 22:52:35.340983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 732/1469] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:35 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:35.599504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fc697dd9-eefe-424b-9adb-314ee5660772 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:35.602113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fc697dd9-eefe-424b-9adb-314ee5660772 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:35.608482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc697dd9-eefe-424b-9adb-314ee5660772 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.609132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc697dd9-eefe-424b-9adb-314ee5660772 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.609610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc697dd9-eefe-424b-9adb-314ee5660772 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.610443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc697dd9-eefe-424b-9adb-314ee5660772 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.610963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc697dd9-eefe-424b-9adb-314ee5660772 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.611427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc697dd9-eefe-424b-9adb-314ee5660772 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.644984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fc697dd9-eefe-424b-9adb-314ee5660772 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049547 Aug 29 22:52:35.645578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 738/1470] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:52:35.824600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-235b213b-8e5c-47bc-8082-1ab7778eb653 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:35.826772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-235b213b-8e5c-47bc-8082-1ab7778eb653 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:35.834883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-235b213b-8e5c-47bc-8082-1ab7778eb653 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.835377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-235b213b-8e5c-47bc-8082-1ab7778eb653 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.835814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-235b213b-8e5c-47bc-8082-1ab7778eb653 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.836560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-235b213b-8e5c-47bc-8082-1ab7778eb653 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.837020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-235b213b-8e5c-47bc-8082-1ab7778eb653 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.837457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-235b213b-8e5c-47bc-8082-1ab7778eb653 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.873408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-235b213b-8e5c-47bc-8082-1ab7778eb653 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052880 Aug 29 22:52:35.874029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 733/1471] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:36.013285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3fd90778-ac06-4948-95f3-176ca8a22528 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:36.015438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3fd90778-ac06-4948-95f3-176ca8a22528 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:36.022553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fd90778-ac06-4948-95f3-176ca8a22528 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.023046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fd90778-ac06-4948-95f3-176ca8a22528 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.023482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fd90778-ac06-4948-95f3-176ca8a22528 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.024209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fd90778-ac06-4948-95f3-176ca8a22528 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.024663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fd90778-ac06-4948-95f3-176ca8a22528 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.025086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3fd90778-ac06-4948-95f3-176ca8a22528 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.058355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3fd90778-ac06-4948-95f3-176ca8a22528 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048957 Aug 29 22:52:36.058939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 739/1472] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:36.361291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:36.361886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:36.369189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.369676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.370109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.370800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.371247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.371665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.441269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:36.449379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2742f58a-f4cf-495e-b08f-058ece892525 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092086 Aug 29 22:52:36.449952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 734/1473] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:36 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:36.659216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-87a6c9f4-098b-433d-bc58-93fee289a217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:36.661487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-87a6c9f4-098b-433d-bc58-93fee289a217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:36.667623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87a6c9f4-098b-433d-bc58-93fee289a217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.668100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87a6c9f4-098b-433d-bc58-93fee289a217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.668561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87a6c9f4-098b-433d-bc58-93fee289a217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.669254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87a6c9f4-098b-433d-bc58-93fee289a217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.669704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87a6c9f4-098b-433d-bc58-93fee289a217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.670121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87a6c9f4-098b-433d-bc58-93fee289a217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.701244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-87a6c9f4-098b-433d-bc58-93fee289a217 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046029 Aug 29 22:52:36.701962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 740/1474] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:36.887235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f341957f-14de-4983-af3b-7223244a23a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:36.889500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f341957f-14de-4983-af3b-7223244a23a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:36.895677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f341957f-14de-4983-af3b-7223244a23a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.896210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f341957f-14de-4983-af3b-7223244a23a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.896655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f341957f-14de-4983-af3b-7223244a23a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.897352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f341957f-14de-4983-af3b-7223244a23a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.897804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f341957f-14de-4983-af3b-7223244a23a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.898225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f341957f-14de-4983-af3b-7223244a23a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.930588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f341957f-14de-4983-af3b-7223244a23a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047807 Aug 29 22:52:36.931167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 735/1475] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:37.071230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e53c3adb-5bfd-4dba-b2b8-0f6dae34d3bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:37.073407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e53c3adb-5bfd-4dba-b2b8-0f6dae34d3bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:37.080118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e53c3adb-5bfd-4dba-b2b8-0f6dae34d3bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:37.080691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e53c3adb-5bfd-4dba-b2b8-0f6dae34d3bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:37.081122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e53c3adb-5bfd-4dba-b2b8-0f6dae34d3bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:37.081923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e53c3adb-5bfd-4dba-b2b8-0f6dae34d3bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:37.082375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e53c3adb-5bfd-4dba-b2b8-0f6dae34d3bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:37.082800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e53c3adb-5bfd-4dba-b2b8-0f6dae34d3bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:37.114458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e53c3adb-5bfd-4dba-b2b8-0f6dae34d3bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047240 Aug 29 22:52:37.115131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 741/1476] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:37.472115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:37.473087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:37.479497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:37.479985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:37.480456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:37.481164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:37.481621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:37.482044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:37.545736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:37.555088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7bf36399-9258-44a3-b756-e1da286fd71f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087461 Aug 29 22:52:37.555660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 736/1477] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:37 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:37.715297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eb32d772-769d-4b91-ab83-714650af7ed5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:37.717465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eb32d772-769d-4b91-ab83-714650af7ed5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:37.724401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb32d772-769d-4b91-ab83-714650af7ed5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:37.724878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb32d772-769d-4b91-ab83-714650af7ed5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:37.725309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb32d772-769d-4b91-ab83-714650af7ed5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:37.725996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb32d772-769d-4b91-ab83-714650af7ed5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:37.726438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb32d772-769d-4b91-ab83-714650af7ed5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:37.726852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb32d772-769d-4b91-ab83-714650af7ed5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:37.758402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eb32d772-769d-4b91-ab83-714650af7ed5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047114 Aug 29 22:52:37.758974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 742/1478] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:37.943281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c32973f9-d18f-47bb-83af-a2617fa0a47c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:37.945508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c32973f9-d18f-47bb-83af-a2617fa0a47c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:37.954396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c32973f9-d18f-47bb-83af-a2617fa0a47c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:37.955996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c32973f9-d18f-47bb-83af-a2617fa0a47c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:37.956479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c32973f9-d18f-47bb-83af-a2617fa0a47c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:37.957296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c32973f9-d18f-47bb-83af-a2617fa0a47c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:37.957859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c32973f9-d18f-47bb-83af-a2617fa0a47c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:37.958282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c32973f9-d18f-47bb-83af-a2617fa0a47c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:37.986781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:37.992007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c32973f9-d18f-47bb-83af-a2617fa0a47c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052821 Aug 29 22:52:37.993846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 737/1479] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:38.127084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bbeae17f-13ef-498c-99e0-dbdbef9162bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:38.129635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bbeae17f-13ef-498c-99e0-dbdbef9162bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:38.136212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbeae17f-13ef-498c-99e0-dbdbef9162bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:38.136699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbeae17f-13ef-498c-99e0-dbdbef9162bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:38.137135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbeae17f-13ef-498c-99e0-dbdbef9162bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:38.137839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbeae17f-13ef-498c-99e0-dbdbef9162bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:38.138286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbeae17f-13ef-498c-99e0-dbdbef9162bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:38.138706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bbeae17f-13ef-498c-99e0-dbdbef9162bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:38.170598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bbeae17f-13ef-498c-99e0-dbdbef9162bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Aug 29 22:52:38.171177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 743/1480] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:38.576747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:38.577306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:38.585445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:38.585927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:38.586359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:38.587049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:38.587534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:38.587954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:38.650876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:38.658786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d900a2a0-d202-427d-bbad-18df1c4a4b06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086342 Aug 29 22:52:38.659432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 738/1481] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:38 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:38.771380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0a68c9fd-4c93-4f45-ac6a-4389f602892b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:38.773577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0a68c9fd-4c93-4f45-ac6a-4389f602892b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:38.779691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a68c9fd-4c93-4f45-ac6a-4389f602892b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:38.780188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a68c9fd-4c93-4f45-ac6a-4389f602892b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:38.780618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a68c9fd-4c93-4f45-ac6a-4389f602892b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:38.781333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a68c9fd-4c93-4f45-ac6a-4389f602892b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:38.781776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a68c9fd-4c93-4f45-ac6a-4389f602892b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:38.782186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a68c9fd-4c93-4f45-ac6a-4389f602892b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:38.816250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0a68c9fd-4c93-4f45-ac6a-4389f602892b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048120 Aug 29 22:52:38.816872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 744/1482] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:39.004106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3a5f6b95-f8cb-444d-9b95-34ff59a483be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:39.006404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3a5f6b95-f8cb-444d-9b95-34ff59a483be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:39.012420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b95-f8cb-444d-9b95-34ff59a483be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.012909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b95-f8cb-444d-9b95-34ff59a483be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.013338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b95-f8cb-444d-9b95-34ff59a483be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.014042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b95-f8cb-444d-9b95-34ff59a483be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.014489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b95-f8cb-444d-9b95-34ff59a483be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.014907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a5f6b95-f8cb-444d-9b95-34ff59a483be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.046899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3a5f6b95-f8cb-444d-9b95-34ff59a483be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Aug 29 22:52:39.047474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 739/1483] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:39.182967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9270258b-5eb4-4699-9498-4803b8fbd10a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:39.185329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9270258b-5eb4-4699-9498-4803b8fbd10a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:39.191988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9270258b-5eb4-4699-9498-4803b8fbd10a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.192501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9270258b-5eb4-4699-9498-4803b8fbd10a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.192943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9270258b-5eb4-4699-9498-4803b8fbd10a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.193652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9270258b-5eb4-4699-9498-4803b8fbd10a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.194109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9270258b-5eb4-4699-9498-4803b8fbd10a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.194551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9270258b-5eb4-4699-9498-4803b8fbd10a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.225630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9270258b-5eb4-4699-9498-4803b8fbd10a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 Aug 29 22:52:39.226210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 745/1484] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:39.679540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:39.680150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:39.686765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.687243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.687676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.688672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.688841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.689265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.755695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:39.760918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-74b768f6-247d-478d-9e4f-d1c8c7082ac0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085253 Aug 29 22:52:39.761496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 740/1485] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:39 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:39.829996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-001e6aeb-fa5e-4e3f-9b5e-44d1d755de93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:39.835637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-001e6aeb-fa5e-4e3f-9b5e-44d1d755de93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:39.839298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-001e6aeb-fa5e-4e3f-9b5e-44d1d755de93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.839785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-001e6aeb-fa5e-4e3f-9b5e-44d1d755de93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.840260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-001e6aeb-fa5e-4e3f-9b5e-44d1d755de93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.840959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-001e6aeb-fa5e-4e3f-9b5e-44d1d755de93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.841418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-001e6aeb-fa5e-4e3f-9b5e-44d1d755de93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.841846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-001e6aeb-fa5e-4e3f-9b5e-44d1d755de93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.871911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-001e6aeb-fa5e-4e3f-9b5e-44d1d755de93 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046992 Aug 29 22:52:39.872530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 746/1486] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:40.060207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c59827ad-4902-4524-8e58-f3125010b84c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:40.062295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c59827ad-4902-4524-8e58-f3125010b84c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:40.069265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c59827ad-4902-4524-8e58-f3125010b84c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.069747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c59827ad-4902-4524-8e58-f3125010b84c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.070232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c59827ad-4902-4524-8e58-f3125010b84c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.070956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c59827ad-4902-4524-8e58-f3125010b84c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.071408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c59827ad-4902-4524-8e58-f3125010b84c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.071857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c59827ad-4902-4524-8e58-f3125010b84c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.103510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c59827ad-4902-4524-8e58-f3125010b84c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Aug 29 22:52:40.104081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 741/1487] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:40 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:40.238606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b0ce80fd-5c76-46cc-9ce1-4c40fe9610c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:40.240898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b0ce80fd-5c76-46cc-9ce1-4c40fe9610c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:40.247403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0ce80fd-5c76-46cc-9ce1-4c40fe9610c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.247890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0ce80fd-5c76-46cc-9ce1-4c40fe9610c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.248373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0ce80fd-5c76-46cc-9ce1-4c40fe9610c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.249076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0ce80fd-5c76-46cc-9ce1-4c40fe9610c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.249534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0ce80fd-5c76-46cc-9ce1-4c40fe9610c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.249964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0ce80fd-5c76-46cc-9ce1-4c40fe9610c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.280871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b0ce80fd-5c76-46cc-9ce1-4c40fe9610c0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046830 Aug 29 22:52:40.281423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 747/1488] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:40.783138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:40.784288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:40.791263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.791750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.792203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.792900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.793351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.793783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.863453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:40.871594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-539d5928-88e4-4702-a15f-a8e9b6b67929 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092521 Aug 29 22:52:40.872186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 742/1489] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:40 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:40.884382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5d1e81dc-0b4e-44b8-8558-0f21567d3b8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:40.886575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5d1e81dc-0b4e-44b8-8558-0f21567d3b8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:40.892593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1e81dc-0b4e-44b8-8558-0f21567d3b8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.893360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1e81dc-0b4e-44b8-8558-0f21567d3b8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.893521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1e81dc-0b4e-44b8-8558-0f21567d3b8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.894255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1e81dc-0b4e-44b8-8558-0f21567d3b8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.894708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1e81dc-0b4e-44b8-8558-0f21567d3b8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.895130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1e81dc-0b4e-44b8-8558-0f21567d3b8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.926743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5d1e81dc-0b4e-44b8-8558-0f21567d3b8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046406 Aug 29 22:52:40.928407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 748/1490] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:41.115418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-58edbcab-46c5-4752-9464-bcbba50fd626 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:41.117559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-58edbcab-46c5-4752-9464-bcbba50fd626 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:41.124030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-58edbcab-46c5-4752-9464-bcbba50fd626 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.124570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-58edbcab-46c5-4752-9464-bcbba50fd626 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.125011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-58edbcab-46c5-4752-9464-bcbba50fd626 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.125734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-58edbcab-46c5-4752-9464-bcbba50fd626 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.126194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-58edbcab-46c5-4752-9464-bcbba50fd626 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.126626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-58edbcab-46c5-4752-9464-bcbba50fd626 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.158382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-58edbcab-46c5-4752-9464-bcbba50fd626 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047066 Aug 29 22:52:41.160061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 743/1491] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:41.292454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-359f21c1-e876-4dde-a7e0-59ef088f694e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:41.294598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-359f21c1-e876-4dde-a7e0-59ef088f694e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:41.301249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-359f21c1-e876-4dde-a7e0-59ef088f694e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.301738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-359f21c1-e876-4dde-a7e0-59ef088f694e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.302217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-359f21c1-e876-4dde-a7e0-59ef088f694e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.302918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-359f21c1-e876-4dde-a7e0-59ef088f694e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.303368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-359f21c1-e876-4dde-a7e0-59ef088f694e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.303793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-359f21c1-e876-4dde-a7e0-59ef088f694e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.307673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:41.336327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-359f21c1-e876-4dde-a7e0-59ef088f694e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047787 Aug 29 22:52:41.336923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 749/1492] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:41.892480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:41.893845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:41.900325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.900816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.901268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.901970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.902430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.902859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.939434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-54e1512c-8e5f-4538-bedd-c26cfe7d293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:41.942116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-54e1512c-8e5f-4538-bedd-c26cfe7d293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:41.948957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54e1512c-8e5f-4538-bedd-c26cfe7d293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.949531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54e1512c-8e5f-4538-bedd-c26cfe7d293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.950040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54e1512c-8e5f-4538-bedd-c26cfe7d293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.950813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54e1512c-8e5f-4538-bedd-c26cfe7d293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.951276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54e1512c-8e5f-4538-bedd-c26cfe7d293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.951698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54e1512c-8e5f-4538-bedd-c26cfe7d293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.969288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:41.978289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a5109ac9-5210-4f20-a843-44c9fea3aba3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089665 Aug 29 22:52:41.978874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 744/1493] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:41 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:41.985970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-54e1512c-8e5f-4538-bedd-c26cfe7d293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050935 Aug 29 22:52:41.986537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 750/1494] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:52:42.171036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ca9547db-af92-4624-9447-d97bfe6e1d9d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:42.173233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ca9547db-af92-4624-9447-d97bfe6e1d9d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:42.179579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9547db-af92-4624-9447-d97bfe6e1d9d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:42.180057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9547db-af92-4624-9447-d97bfe6e1d9d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:42.180521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9547db-af92-4624-9447-d97bfe6e1d9d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:42.181219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9547db-af92-4624-9447-d97bfe6e1d9d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:42.181670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9547db-af92-4624-9447-d97bfe6e1d9d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:42.182092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca9547db-af92-4624-9447-d97bfe6e1d9d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:42.213229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ca9547db-af92-4624-9447-d97bfe6e1d9d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Aug 29 22:52:42.213800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 745/1495] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:42.348174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-528fd159-5a93-4ac6-901c-5fccf4647cbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:42.350395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-528fd159-5a93-4ac6-901c-5fccf4647cbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:42.356887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-528fd159-5a93-4ac6-901c-5fccf4647cbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:42.357367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-528fd159-5a93-4ac6-901c-5fccf4647cbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:42.357807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-528fd159-5a93-4ac6-901c-5fccf4647cbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:42.358493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-528fd159-5a93-4ac6-901c-5fccf4647cbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:42.358944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-528fd159-5a93-4ac6-901c-5fccf4647cbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:42.359369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-528fd159-5a93-4ac6-901c-5fccf4647cbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:42.390254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-528fd159-5a93-4ac6-901c-5fccf4647cbe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Aug 29 22:52:42.390830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 751/1496] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:42.998858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-93847b7d-8e01-4c52-9533-15e1b72ee68d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:43.000005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:43.000657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:43.001194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-93847b7d-8e01-4c52-9533-15e1b72ee68d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:43.003692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:52:43.003907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 22:52:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments (ip 10.222.0.59) !!! Aug 29 22:52:43.011047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93847b7d-8e01-4c52-9533-15e1b72ee68d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.011528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93847b7d-8e01-4c52-9533-15e1b72ee68d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.011676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.011965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93847b7d-8e01-4c52-9533-15e1b72ee68d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.012177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.012619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.012823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93847b7d-8e01-4c52-9533-15e1b72ee68d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.013279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93847b7d-8e01-4c52-9533-15e1b72ee68d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.013436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.013704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93847b7d-8e01-4c52-9533-15e1b72ee68d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.013865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.014213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.052275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-93847b7d-8e01-4c52-9533-15e1b72ee68d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057432 Aug 29 22:52:43.052866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 746/1497] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:43.084667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:43.092415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-452dd410-a4ac-4c70-a666-a7ffa5d472a5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.096359 Aug 29 22:52:43.092986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 752/1498] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:42 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:43.226671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3ece39e4-0ed9-4e8f-8853-6c80a09a2eec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:43.228770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3ece39e4-0ed9-4e8f-8853-6c80a09a2eec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:43.234757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ece39e4-0ed9-4e8f-8853-6c80a09a2eec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.235239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ece39e4-0ed9-4e8f-8853-6c80a09a2eec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.235675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ece39e4-0ed9-4e8f-8853-6c80a09a2eec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.236407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ece39e4-0ed9-4e8f-8853-6c80a09a2eec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.237013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ece39e4-0ed9-4e8f-8853-6c80a09a2eec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.237569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ece39e4-0ed9-4e8f-8853-6c80a09a2eec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.267607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3ece39e4-0ed9-4e8f-8853-6c80a09a2eec tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Aug 29 22:52:43.268986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 747/1499] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:43.406625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-37f29e8a-8648-4d9f-8ba8-a382f07b0a04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:43.409899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-37f29e8a-8648-4d9f-8ba8-a382f07b0a04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:43.416552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37f29e8a-8648-4d9f-8ba8-a382f07b0a04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.417035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37f29e8a-8648-4d9f-8ba8-a382f07b0a04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.431428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37f29e8a-8648-4d9f-8ba8-a382f07b0a04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.431428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37f29e8a-8648-4d9f-8ba8-a382f07b0a04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.431428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37f29e8a-8648-4d9f-8ba8-a382f07b0a04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.431428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-37f29e8a-8648-4d9f-8ba8-a382f07b0a04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.451662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-37f29e8a-8648-4d9f-8ba8-a382f07b0a04 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050825 Aug 29 22:52:43.452265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 753/1500] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:44.066018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d1479390-31eb-43e2-9298-864cb90fce41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:44.067922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d1479390-31eb-43e2-9298-864cb90fce41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:44.074346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1479390-31eb-43e2-9298-864cb90fce41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.074821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1479390-31eb-43e2-9298-864cb90fce41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.075253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1479390-31eb-43e2-9298-864cb90fce41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.075941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1479390-31eb-43e2-9298-864cb90fce41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.076416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1479390-31eb-43e2-9298-864cb90fce41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.076830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1479390-31eb-43e2-9298-864cb90fce41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.107728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d1479390-31eb-43e2-9298-864cb90fce41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046606 Aug 29 22:52:44.108531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 748/1501] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:44.114578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:44.115179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:44.121180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.121654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.122083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.122765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.123216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.123631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.185217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:44.194276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a3b802e2-b0ac-418d-b663-7c0577e51c06 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084451 Aug 29 22:52:44.194853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 754/1502] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:44 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:44.281102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f56fa8c9-49d2-47da-b9ce-3347872d889d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:44.283231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f56fa8c9-49d2-47da-b9ce-3347872d889d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:44.289866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56fa8c9-49d2-47da-b9ce-3347872d889d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.290341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56fa8c9-49d2-47da-b9ce-3347872d889d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.290783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56fa8c9-49d2-47da-b9ce-3347872d889d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.291450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56fa8c9-49d2-47da-b9ce-3347872d889d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.291896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56fa8c9-49d2-47da-b9ce-3347872d889d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.292345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56fa8c9-49d2-47da-b9ce-3347872d889d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.323339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f56fa8c9-49d2-47da-b9ce-3347872d889d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046067 Aug 29 22:52:44.323819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 749/1503] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:44.465576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1fc0e30e-7456-4a24-8379-da2d23bb5185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:44.467747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1fc0e30e-7456-4a24-8379-da2d23bb5185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:44.474342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fc0e30e-7456-4a24-8379-da2d23bb5185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.474814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fc0e30e-7456-4a24-8379-da2d23bb5185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.475257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fc0e30e-7456-4a24-8379-da2d23bb5185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.475947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fc0e30e-7456-4a24-8379-da2d23bb5185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.476434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fc0e30e-7456-4a24-8379-da2d23bb5185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.476844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fc0e30e-7456-4a24-8379-da2d23bb5185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.507791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1fc0e30e-7456-4a24-8379-da2d23bb5185 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046112 Aug 29 22:52:44.508494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 755/1504] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:45.121375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bbe42cff-0f68-4b32-a225-85484d3fb43f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:45.123623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bbe42cff-0f68-4b32-a225-85484d3fb43f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:45.131337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bbe42cff-0f68-4b32-a225-85484d3fb43f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.131809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bbe42cff-0f68-4b32-a225-85484d3fb43f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.132266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bbe42cff-0f68-4b32-a225-85484d3fb43f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.132955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bbe42cff-0f68-4b32-a225-85484d3fb43f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.133403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bbe42cff-0f68-4b32-a225-85484d3fb43f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.133816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bbe42cff-0f68-4b32-a225-85484d3fb43f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.164688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bbe42cff-0f68-4b32-a225-85484d3fb43f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047216 Aug 29 22:52:45.165293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 750/1505] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:45.215049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:45.215668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:45.221790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.222348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.222774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.223463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.223916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.224521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.285992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:45.293771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c2760e25-d2b5-498e-8a9e-c9c5f19c70ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.082664 Aug 29 22:52:45.294331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 756/1506] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:45 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:45.337025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b081927c-49ab-4096-ae10-cbb949b71192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:45.340689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b081927c-49ab-4096-ae10-cbb949b71192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:45.345437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b081927c-49ab-4096-ae10-cbb949b71192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.346205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b081927c-49ab-4096-ae10-cbb949b71192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.346858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b081927c-49ab-4096-ae10-cbb949b71192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.347093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b081927c-49ab-4096-ae10-cbb949b71192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.347542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b081927c-49ab-4096-ae10-cbb949b71192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.347960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b081927c-49ab-4096-ae10-cbb949b71192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.379485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b081927c-49ab-4096-ae10-cbb949b71192 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046365 Aug 29 22:52:45.380066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 751/1507] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:45.521657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9d623d03-6c40-4efe-8826-7e90ca465d41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:45.523659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9d623d03-6c40-4efe-8826-7e90ca465d41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:45.530460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d623d03-6c40-4efe-8826-7e90ca465d41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.530940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d623d03-6c40-4efe-8826-7e90ca465d41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.531377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d623d03-6c40-4efe-8826-7e90ca465d41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.532073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d623d03-6c40-4efe-8826-7e90ca465d41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.532557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d623d03-6c40-4efe-8826-7e90ca465d41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.532978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d623d03-6c40-4efe-8826-7e90ca465d41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.563407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9d623d03-6c40-4efe-8826-7e90ca465d41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047049 Aug 29 22:52:45.563963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 757/1508] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:46.177896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-db6b533a-c4fc-4375-8361-6f2125c76e22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:46.180049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-db6b533a-c4fc-4375-8361-6f2125c76e22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:46.186511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db6b533a-c4fc-4375-8361-6f2125c76e22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.186981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db6b533a-c4fc-4375-8361-6f2125c76e22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.187422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db6b533a-c4fc-4375-8361-6f2125c76e22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.188093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db6b533a-c4fc-4375-8361-6f2125c76e22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.188616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db6b533a-c4fc-4375-8361-6f2125c76e22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.189033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-db6b533a-c4fc-4375-8361-6f2125c76e22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.220153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-db6b533a-c4fc-4375-8361-6f2125c76e22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046651 Aug 29 22:52:46.220717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 752/1509] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:46.315275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:46.315881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:46.322065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.322545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.322974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.323668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.324115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.324555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.386909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:46.392674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0980d23c-ddc0-4c9f-803b-24225bb4cb1d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:46.395064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-28a347f5-32f2-44f7-9283-b57e666d669d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084171 Aug 29 22:52:46.395358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0980d23c-ddc0-4c9f-803b-24225bb4cb1d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:46.395660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 758/1510] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:46 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:46.401873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0980d23c-ddc0-4c9f-803b-24225bb4cb1d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.402284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0980d23c-ddc0-4c9f-803b-24225bb4cb1d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.402865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0980d23c-ddc0-4c9f-803b-24225bb4cb1d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.403584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0980d23c-ddc0-4c9f-803b-24225bb4cb1d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.404039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0980d23c-ddc0-4c9f-803b-24225bb4cb1d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.404508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0980d23c-ddc0-4c9f-803b-24225bb4cb1d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.439006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0980d23c-ddc0-4c9f-803b-24225bb4cb1d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050054 Aug 29 22:52:46.439493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 753/1511] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:46.575774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f4172617-7eac-48f6-b4b9-e9e81a8ba171 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:46.577979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f4172617-7eac-48f6-b4b9-e9e81a8ba171 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:46.585686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4172617-7eac-48f6-b4b9-e9e81a8ba171 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.586161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4172617-7eac-48f6-b4b9-e9e81a8ba171 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.586590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4172617-7eac-48f6-b4b9-e9e81a8ba171 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.587425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4172617-7eac-48f6-b4b9-e9e81a8ba171 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.587872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4172617-7eac-48f6-b4b9-e9e81a8ba171 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.588324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4172617-7eac-48f6-b4b9-e9e81a8ba171 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.619654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f4172617-7eac-48f6-b4b9-e9e81a8ba171 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047692 Aug 29 22:52:46.620254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 759/1512] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:46 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:47.233177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2ef4a8d5-939a-424b-a64f-8d26d5faeb4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:47.235235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2ef4a8d5-939a-424b-a64f-8d26d5faeb4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:47.241859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8d5-939a-424b-a64f-8d26d5faeb4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.242339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8d5-939a-424b-a64f-8d26d5faeb4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.242773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8d5-939a-424b-a64f-8d26d5faeb4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.243467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8d5-939a-424b-a64f-8d26d5faeb4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.243920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8d5-939a-424b-a64f-8d26d5faeb4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.244374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ef4a8d5-939a-424b-a64f-8d26d5faeb4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.258538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:47.276017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2ef4a8d5-939a-424b-a64f-8d26d5faeb4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046896 Aug 29 22:52:47.276630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 754/1513] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:47.415458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:47.416067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:47.422252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.422752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.423185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.424376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.424966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.425712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.453440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c9db400e-3d7b-413f-8c6c-a85ebffbc181 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:47.456829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c9db400e-3d7b-413f-8c6c-a85ebffbc181 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:47.464896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9db400e-3d7b-413f-8c6c-a85ebffbc181 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.464896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9db400e-3d7b-413f-8c6c-a85ebffbc181 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.464896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9db400e-3d7b-413f-8c6c-a85ebffbc181 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.465927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9db400e-3d7b-413f-8c6c-a85ebffbc181 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.465927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9db400e-3d7b-413f-8c6c-a85ebffbc181 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.466262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9db400e-3d7b-413f-8c6c-a85ebffbc181 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.501237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c9db400e-3d7b-413f-8c6c-a85ebffbc181 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052835 Aug 29 22:52:47.501713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 755/1514] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:47.510957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:47.521281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9429b8c1-f6b2-4269-8dcb-321141100816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.108909 Aug 29 22:52:47.521281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 760/1515] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:47 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:47.631906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ee6cc150-c2d1-4e6e-95bb-91d761e7ab48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:47.634120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ee6cc150-c2d1-4e6e-95bb-91d761e7ab48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:47.640541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee6cc150-c2d1-4e6e-95bb-91d761e7ab48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.641032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee6cc150-c2d1-4e6e-95bb-91d761e7ab48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.641471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee6cc150-c2d1-4e6e-95bb-91d761e7ab48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.642175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee6cc150-c2d1-4e6e-95bb-91d761e7ab48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.642635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee6cc150-c2d1-4e6e-95bb-91d761e7ab48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.643690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee6cc150-c2d1-4e6e-95bb-91d761e7ab48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.679577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ee6cc150-c2d1-4e6e-95bb-91d761e7ab48 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052063 Aug 29 22:52:47.680422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 756/1516] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:48.287933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a625b138-b4f3-4f1f-98d8-1aaae4e48340 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:48.290120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a625b138-b4f3-4f1f-98d8-1aaae4e48340 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:48.296749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a625b138-b4f3-4f1f-98d8-1aaae4e48340 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.297216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a625b138-b4f3-4f1f-98d8-1aaae4e48340 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.297638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a625b138-b4f3-4f1f-98d8-1aaae4e48340 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.298315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a625b138-b4f3-4f1f-98d8-1aaae4e48340 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.298757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a625b138-b4f3-4f1f-98d8-1aaae4e48340 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.299169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a625b138-b4f3-4f1f-98d8-1aaae4e48340 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.331192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a625b138-b4f3-4f1f-98d8-1aaae4e48340 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046577 Aug 29 22:52:48.331661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 761/1517] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:52:48.515509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df11fe39-8176-4d1f-b335-b4a0fecde0d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:48.518313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-df11fe39-8176-4d1f-b335-b4a0fecde0d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:48.525124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df11fe39-8176-4d1f-b335-b4a0fecde0d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.525598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df11fe39-8176-4d1f-b335-b4a0fecde0d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.526029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df11fe39-8176-4d1f-b335-b4a0fecde0d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.526719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df11fe39-8176-4d1f-b335-b4a0fecde0d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.527167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df11fe39-8176-4d1f-b335-b4a0fecde0d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.527589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df11fe39-8176-4d1f-b335-b4a0fecde0d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.545372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:48.545992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:48.552596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.553073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.553515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.554237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.554964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.555387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.559794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-df11fe39-8176-4d1f-b335-b4a0fecde0d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048203 Aug 29 22:52:48.560396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 757/1518] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:48.619576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:48.627422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4390c099-bdf5-4c1f-b91f-abc9c36a1891 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086207 Aug 29 22:52:48.628022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 762/1519] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:48 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:48.693901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8837cd9d-99d4-4d0c-9564-7d438a30dbda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:48.696051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8837cd9d-99d4-4d0c-9564-7d438a30dbda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:48.702316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8837cd9d-99d4-4d0c-9564-7d438a30dbda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.702810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8837cd9d-99d4-4d0c-9564-7d438a30dbda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.703253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8837cd9d-99d4-4d0c-9564-7d438a30dbda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.703940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8837cd9d-99d4-4d0c-9564-7d438a30dbda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.704693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8837cd9d-99d4-4d0c-9564-7d438a30dbda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.705666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8837cd9d-99d4-4d0c-9564-7d438a30dbda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.737689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8837cd9d-99d4-4d0c-9564-7d438a30dbda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048061 Aug 29 22:52:48.738255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 758/1520] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:49.343636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-22e07df3-17e9-4b42-bfb1-4b27e9c68128 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:49.345771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-22e07df3-17e9-4b42-bfb1-4b27e9c68128 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:49.353209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e07df3-17e9-4b42-bfb1-4b27e9c68128 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.353714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e07df3-17e9-4b42-bfb1-4b27e9c68128 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.354142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e07df3-17e9-4b42-bfb1-4b27e9c68128 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.354850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e07df3-17e9-4b42-bfb1-4b27e9c68128 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.355270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e07df3-17e9-4b42-bfb1-4b27e9c68128 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.355693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e07df3-17e9-4b42-bfb1-4b27e9c68128 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.384991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-22e07df3-17e9-4b42-bfb1-4b27e9c68128 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045403 Aug 29 22:52:49.385556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 763/1521] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:49.572470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4d216ea7-04c0-4b46-a60c-495de872b6dc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:49.574617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4d216ea7-04c0-4b46-a60c-495de872b6dc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:49.581975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d216ea7-04c0-4b46-a60c-495de872b6dc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.582444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d216ea7-04c0-4b46-a60c-495de872b6dc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.582872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d216ea7-04c0-4b46-a60c-495de872b6dc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.583575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d216ea7-04c0-4b46-a60c-495de872b6dc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.584010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d216ea7-04c0-4b46-a60c-495de872b6dc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.584453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d216ea7-04c0-4b46-a60c-495de872b6dc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.614537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4d216ea7-04c0-4b46-a60c-495de872b6dc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045996 Aug 29 22:52:49.615068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 759/1522] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:49.648610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:49.649207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:49.655169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.655645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.656070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.656768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.657282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.657740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.720948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:49.728981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1c17e339-9338-41a1-8c09-184fc318dc95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084231 Aug 29 22:52:49.729547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 764/1523] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:49 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:49.750574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5eb6397f-ded7-4bf8-a1be-508be36d751c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:49.753613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5eb6397f-ded7-4bf8-a1be-508be36d751c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:49.759991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eb6397f-ded7-4bf8-a1be-508be36d751c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.760518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eb6397f-ded7-4bf8-a1be-508be36d751c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.760954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eb6397f-ded7-4bf8-a1be-508be36d751c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.761657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eb6397f-ded7-4bf8-a1be-508be36d751c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.762110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eb6397f-ded7-4bf8-a1be-508be36d751c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.762532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eb6397f-ded7-4bf8-a1be-508be36d751c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.793667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5eb6397f-ded7-4bf8-a1be-508be36d751c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047430 Aug 29 22:52:49.794376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 760/1524] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:49 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:50.398453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a9e61926-47e5-41ed-b2fc-cd46d019a8d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:50.400793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a9e61926-47e5-41ed-b2fc-cd46d019a8d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:50.403149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:50.407804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9e61926-47e5-41ed-b2fc-cd46d019a8d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.408820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9e61926-47e5-41ed-b2fc-cd46d019a8d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.409260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9e61926-47e5-41ed-b2fc-cd46d019a8d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.410854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9e61926-47e5-41ed-b2fc-cd46d019a8d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.410854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9e61926-47e5-41ed-b2fc-cd46d019a8d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.411702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9e61926-47e5-41ed-b2fc-cd46d019a8d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.440589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:50.445688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a9e61926-47e5-41ed-b2fc-cd46d019a8d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051295 Aug 29 22:52:50.446314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 765/1525] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:50.627246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d36d9db0-59b1-4896-ac29-2250b0a89430 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:50.629952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d36d9db0-59b1-4896-ac29-2250b0a89430 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:50.637434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d36d9db0-59b1-4896-ac29-2250b0a89430 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.638019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d36d9db0-59b1-4896-ac29-2250b0a89430 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.638523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d36d9db0-59b1-4896-ac29-2250b0a89430 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.639494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d36d9db0-59b1-4896-ac29-2250b0a89430 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.639956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d36d9db0-59b1-4896-ac29-2250b0a89430 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.640416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d36d9db0-59b1-4896-ac29-2250b0a89430 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.673559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d36d9db0-59b1-4896-ac29-2250b0a89430 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050275 Aug 29 22:52:50.674665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 761/1526] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:50.750444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:50.751085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:50.757955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.758434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.758866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.759564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.760008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.760453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.807018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-523e29c2-00cf-452f-b4e7-7a96a7e5edfc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:50.809215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-523e29c2-00cf-452f-b4e7-7a96a7e5edfc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:50.815823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-523e29c2-00cf-452f-b4e7-7a96a7e5edfc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.816578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-523e29c2-00cf-452f-b4e7-7a96a7e5edfc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.817342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-523e29c2-00cf-452f-b4e7-7a96a7e5edfc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.818557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-523e29c2-00cf-452f-b4e7-7a96a7e5edfc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.819341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-523e29c2-00cf-452f-b4e7-7a96a7e5edfc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.819852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-523e29c2-00cf-452f-b4e7-7a96a7e5edfc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.838228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:50.853486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-671ccd0b-7744-4988-91b5-3fa547c58421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.106926 Aug 29 22:52:50.854677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 766/1527] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:50 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:50.859314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-523e29c2-00cf-452f-b4e7-7a96a7e5edfc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056395 Aug 29 22:52:50.859902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 762/1528] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:51.462387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8eca20e2-3ac7-4fd6-ba2b-9df198d1be20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:51.465860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8eca20e2-3ac7-4fd6-ba2b-9df198d1be20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:51.474854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8eca20e2-3ac7-4fd6-ba2b-9df198d1be20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.475343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8eca20e2-3ac7-4fd6-ba2b-9df198d1be20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.475769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8eca20e2-3ac7-4fd6-ba2b-9df198d1be20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.476538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8eca20e2-3ac7-4fd6-ba2b-9df198d1be20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.477072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8eca20e2-3ac7-4fd6-ba2b-9df198d1be20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.477680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8eca20e2-3ac7-4fd6-ba2b-9df198d1be20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.515721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8eca20e2-3ac7-4fd6-ba2b-9df198d1be20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060312 Aug 29 22:52:51.516367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 767/1529] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:51.687222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3026d739-1ea3-4d34-b64a-8aad3b17bcce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:51.689848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3026d739-1ea3-4d34-b64a-8aad3b17bcce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:51.696674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3026d739-1ea3-4d34-b64a-8aad3b17bcce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.697156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3026d739-1ea3-4d34-b64a-8aad3b17bcce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.697584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3026d739-1ea3-4d34-b64a-8aad3b17bcce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.698283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3026d739-1ea3-4d34-b64a-8aad3b17bcce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.698718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3026d739-1ea3-4d34-b64a-8aad3b17bcce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.699143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3026d739-1ea3-4d34-b64a-8aad3b17bcce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.733024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3026d739-1ea3-4d34-b64a-8aad3b17bcce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049797 Aug 29 22:52:51.733574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 763/1530] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:51.871739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-879b34f3-452f-453d-9556-0e74c251db30 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:51.873951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-879b34f3-452f-453d-9556-0e74c251db30 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:51.881257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-879b34f3-452f-453d-9556-0e74c251db30 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.881755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-879b34f3-452f-453d-9556-0e74c251db30 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.882201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-879b34f3-452f-453d-9556-0e74c251db30 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.882916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-879b34f3-452f-453d-9556-0e74c251db30 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.883381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-879b34f3-452f-453d-9556-0e74c251db30 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.883805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-879b34f3-452f-453d-9556-0e74c251db30 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.891786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:51.892607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:51.899996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.900566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.900882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.901615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.902034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.902457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.919619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-879b34f3-452f-453d-9556-0e74c251db30 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051401 Aug 29 22:52:51.924358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 768/1531] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:51.967726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:51.975743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-31097cf5-83c0-4dec-aa1e-9da4e6b5939f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088212 Aug 29 22:52:51.976358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 764/1532] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:51 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:52.528973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b074b831-aed9-4bfc-b15d-a5ce7958e094 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:52.531115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b074b831-aed9-4bfc-b15d-a5ce7958e094 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:52.538002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b074b831-aed9-4bfc-b15d-a5ce7958e094 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:52.538474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b074b831-aed9-4bfc-b15d-a5ce7958e094 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:52.538901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b074b831-aed9-4bfc-b15d-a5ce7958e094 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:52.539592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b074b831-aed9-4bfc-b15d-a5ce7958e094 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:52.540030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b074b831-aed9-4bfc-b15d-a5ce7958e094 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:52.540477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b074b831-aed9-4bfc-b15d-a5ce7958e094 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:52.572246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b074b831-aed9-4bfc-b15d-a5ce7958e094 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047170 Aug 29 22:52:52.572813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 769/1533] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:52.745221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2dea6b5c-01c6-49e9-bab6-35b92933eaa9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:52.747403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2dea6b5c-01c6-49e9-bab6-35b92933eaa9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:52.753531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dea6b5c-01c6-49e9-bab6-35b92933eaa9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:52.754017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dea6b5c-01c6-49e9-bab6-35b92933eaa9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:52.754439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dea6b5c-01c6-49e9-bab6-35b92933eaa9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:52.755134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dea6b5c-01c6-49e9-bab6-35b92933eaa9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:52.755584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dea6b5c-01c6-49e9-bab6-35b92933eaa9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:52.756010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dea6b5c-01c6-49e9-bab6-35b92933eaa9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:52.786575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2dea6b5c-01c6-49e9-bab6-35b92933eaa9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Aug 29 22:52:52.787118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 765/1534] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:52.931688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-535fcf1c-90b1-4c18-8bce-b70acb499315 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:52.933919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-535fcf1c-90b1-4c18-8bce-b70acb499315 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:52.941150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-535fcf1c-90b1-4c18-8bce-b70acb499315 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:52.941723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-535fcf1c-90b1-4c18-8bce-b70acb499315 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:52.942094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-535fcf1c-90b1-4c18-8bce-b70acb499315 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:52.942805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-535fcf1c-90b1-4c18-8bce-b70acb499315 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:52.943249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-535fcf1c-90b1-4c18-8bce-b70acb499315 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:52.943668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-535fcf1c-90b1-4c18-8bce-b70acb499315 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:52.979355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-535fcf1c-90b1-4c18-8bce-b70acb499315 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051655 Aug 29 22:52:52.979946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 770/1535] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:52.997289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:52.997762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:53.004831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.005317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.005747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.006450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.006927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.007346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.074038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:53.083021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-849454c2-545d-404e-8749-0a4659ebfb95 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089864 Aug 29 22:52:53.083598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 766/1536] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:52 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:53.585605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6eb47829-66fa-4a83-b154-4e25770122f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:53.587808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6eb47829-66fa-4a83-b154-4e25770122f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:53.593934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb47829-66fa-4a83-b154-4e25770122f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.594414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb47829-66fa-4a83-b154-4e25770122f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.594852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb47829-66fa-4a83-b154-4e25770122f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.595548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb47829-66fa-4a83-b154-4e25770122f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.596740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb47829-66fa-4a83-b154-4e25770122f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.597188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb47829-66fa-4a83-b154-4e25770122f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.628353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6eb47829-66fa-4a83-b154-4e25770122f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046903 Aug 29 22:52:53.628927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 771/1537] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:53.798510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e0905422-40ae-42aa-a943-e1fd1f35b6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:53.800998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e0905422-40ae-42aa-a943-e1fd1f35b6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:53.807735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0905422-40ae-42aa-a943-e1fd1f35b6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.808367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0905422-40ae-42aa-a943-e1fd1f35b6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.808810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0905422-40ae-42aa-a943-e1fd1f35b6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.809519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0905422-40ae-42aa-a943-e1fd1f35b6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.810131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0905422-40ae-42aa-a943-e1fd1f35b6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.810558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0905422-40ae-42aa-a943-e1fd1f35b6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.844626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e0905422-40ae-42aa-a943-e1fd1f35b6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049957 Aug 29 22:52:53.845167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 767/1538] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:53 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:53.991512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-18b50d5d-85ee-4c96-b20a-d2e2dcaaf49e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:53.993767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-18b50d5d-85ee-4c96-b20a-d2e2dcaaf49e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:54.000391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18b50d5d-85ee-4c96-b20a-d2e2dcaaf49e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.000872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18b50d5d-85ee-4c96-b20a-d2e2dcaaf49e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.001302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18b50d5d-85ee-4c96-b20a-d2e2dcaaf49e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.002352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18b50d5d-85ee-4c96-b20a-d2e2dcaaf49e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.002812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18b50d5d-85ee-4c96-b20a-d2e2dcaaf49e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.003234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18b50d5d-85ee-4c96-b20a-d2e2dcaaf49e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.035901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-18b50d5d-85ee-4c96-b20a-d2e2dcaaf49e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048304 Aug 29 22:52:54.036512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 772/1539] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:54.105411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:54.106204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:54.112832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.113661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.114202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.114944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.115398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.115828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.184870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:54.193671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fd5a87f8-5ed7-4535-81e4-7fb6c5c6cdf2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092422 Aug 29 22:52:54.194249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 768/1540] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:54 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:54.641302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2ed24f5d-235b-46a5-887b-e1d1ead60d61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:54.643511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2ed24f5d-235b-46a5-887b-e1d1ead60d61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:54.649548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed24f5d-235b-46a5-887b-e1d1ead60d61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.650016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed24f5d-235b-46a5-887b-e1d1ead60d61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.650439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed24f5d-235b-46a5-887b-e1d1ead60d61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.651120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed24f5d-235b-46a5-887b-e1d1ead60d61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.651561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed24f5d-235b-46a5-887b-e1d1ead60d61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.651973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ed24f5d-235b-46a5-887b-e1d1ead60d61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.683205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2ed24f5d-235b-46a5-887b-e1d1ead60d61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045821 Aug 29 22:52:54.683871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 773/1541] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:54.858793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-692b6cc5-deed-4670-abd4-9da14cac446b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:54.862234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-692b6cc5-deed-4670-abd4-9da14cac446b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:54.869730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692b6cc5-deed-4670-abd4-9da14cac446b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.870170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692b6cc5-deed-4670-abd4-9da14cac446b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.870599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692b6cc5-deed-4670-abd4-9da14cac446b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.871300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692b6cc5-deed-4670-abd4-9da14cac446b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.871744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692b6cc5-deed-4670-abd4-9da14cac446b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.872182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692b6cc5-deed-4670-abd4-9da14cac446b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.902956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-692b6cc5-deed-4670-abd4-9da14cac446b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048004 Aug 29 22:52:54.903435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 769/1542] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:55.048538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e5aa4c30-df87-43a6-b22f-b095e6f0b41a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:55.051367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e5aa4c30-df87-43a6-b22f-b095e6f0b41a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:55.058702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5aa4c30-df87-43a6-b22f-b095e6f0b41a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.059191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5aa4c30-df87-43a6-b22f-b095e6f0b41a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.059642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5aa4c30-df87-43a6-b22f-b095e6f0b41a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.060355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5aa4c30-df87-43a6-b22f-b095e6f0b41a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.060808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5aa4c30-df87-43a6-b22f-b095e6f0b41a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.061233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5aa4c30-df87-43a6-b22f-b095e6f0b41a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.092919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e5aa4c30-df87-43a6-b22f-b095e6f0b41a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048539 Aug 29 22:52:55.093518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 774/1543] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:55.215188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:55.215698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:55.222282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.222758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.223184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.223862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.224354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.224772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.286124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:55.293925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c1a07595-5148-4563-b906-5c8f7f8c3ddf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.082741 Aug 29 22:52:55.294613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 770/1544] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:55 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:55.696040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-acd36440-19bb-4c45-90d9-14a4259aa675 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:55.698212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-acd36440-19bb-4c45-90d9-14a4259aa675 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:55.704844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acd36440-19bb-4c45-90d9-14a4259aa675 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.705912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acd36440-19bb-4c45-90d9-14a4259aa675 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.706396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acd36440-19bb-4c45-90d9-14a4259aa675 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.707133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acd36440-19bb-4c45-90d9-14a4259aa675 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.707585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acd36440-19bb-4c45-90d9-14a4259aa675 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.708001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acd36440-19bb-4c45-90d9-14a4259aa675 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.738396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-acd36440-19bb-4c45-90d9-14a4259aa675 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046352 Aug 29 22:52:55.739020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 775/1545] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:55 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:52:55.915049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2045bfc7-f09f-4329-8fbc-a36d5dd9a594 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:55.917549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2045bfc7-f09f-4329-8fbc-a36d5dd9a594 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:55.924804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2045bfc7-f09f-4329-8fbc-a36d5dd9a594 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.925446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2045bfc7-f09f-4329-8fbc-a36d5dd9a594 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.925893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2045bfc7-f09f-4329-8fbc-a36d5dd9a594 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.926624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2045bfc7-f09f-4329-8fbc-a36d5dd9a594 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.927090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2045bfc7-f09f-4329-8fbc-a36d5dd9a594 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.927575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2045bfc7-f09f-4329-8fbc-a36d5dd9a594 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.931843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:55.961223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2045bfc7-f09f-4329-8fbc-a36d5dd9a594 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049922 Aug 29 22:52:55.961996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 771/1546] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:56.106148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ae92d75c-a2d5-4ff5-b3db-c56fe6fdfde7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:56.108530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ae92d75c-a2d5-4ff5-b3db-c56fe6fdfde7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:56.115572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae92d75c-a2d5-4ff5-b3db-c56fe6fdfde7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.116052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae92d75c-a2d5-4ff5-b3db-c56fe6fdfde7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.116522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae92d75c-a2d5-4ff5-b3db-c56fe6fdfde7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.117211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae92d75c-a2d5-4ff5-b3db-c56fe6fdfde7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.117714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae92d75c-a2d5-4ff5-b3db-c56fe6fdfde7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.118074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae92d75c-a2d5-4ff5-b3db-c56fe6fdfde7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.149860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ae92d75c-a2d5-4ff5-b3db-c56fe6fdfde7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047552 Aug 29 22:52:56.150438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 776/1547] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:56.314917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:56.315652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:56.317900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:56.328009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.328009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.328009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.328009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.328466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.328466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.392575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:56.402287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4700b0bd-beba-4489-b93a-0483f18a7c49 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091268 Aug 29 22:52:56.402872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 772/1548] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:56 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:56.751167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0c368386-4704-4d8d-8869-9e8d247003b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:56.753346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0c368386-4704-4d8d-8869-9e8d247003b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:56.759524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c368386-4704-4d8d-8869-9e8d247003b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.760009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c368386-4704-4d8d-8869-9e8d247003b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.760485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c368386-4704-4d8d-8869-9e8d247003b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.761195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c368386-4704-4d8d-8869-9e8d247003b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.761648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c368386-4704-4d8d-8869-9e8d247003b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.762074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c368386-4704-4d8d-8869-9e8d247003b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.793076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0c368386-4704-4d8d-8869-9e8d247003b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046060 Aug 29 22:52:56.793696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 777/1549] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:56.976222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2f01c13e-2f52-4b86-b7c4-8ed5c1fbfd80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:56.978419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2f01c13e-2f52-4b86-b7c4-8ed5c1fbfd80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:56.984485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f01c13e-2f52-4b86-b7c4-8ed5c1fbfd80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.984969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f01c13e-2f52-4b86-b7c4-8ed5c1fbfd80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.985403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f01c13e-2f52-4b86-b7c4-8ed5c1fbfd80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.986228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f01c13e-2f52-4b86-b7c4-8ed5c1fbfd80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.986950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f01c13e-2f52-4b86-b7c4-8ed5c1fbfd80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.987382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f01c13e-2f52-4b86-b7c4-8ed5c1fbfd80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.017252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2f01c13e-2f52-4b86-b7c4-8ed5c1fbfd80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046552 Aug 29 22:52:57.018658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 773/1550] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:57.162754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-96c48f3c-abb4-4757-b14d-5d68e990868b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:57.164941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-96c48f3c-abb4-4757-b14d-5d68e990868b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:57.171570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96c48f3c-abb4-4757-b14d-5d68e990868b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.172054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96c48f3c-abb4-4757-b14d-5d68e990868b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.172520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96c48f3c-abb4-4757-b14d-5d68e990868b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.173215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96c48f3c-abb4-4757-b14d-5d68e990868b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.173783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96c48f3c-abb4-4757-b14d-5d68e990868b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.174404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96c48f3c-abb4-4757-b14d-5d68e990868b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.210863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-96c48f3c-abb4-4757-b14d-5d68e990868b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052437 Aug 29 22:52:57.211426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 778/1551] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:57.423051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:57.424188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:57.430851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.431344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.431783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.432523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.433095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.433553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.502981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:57.511567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ff08947f-e3d5-4d7d-9401-edb072e16547 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092462 Aug 29 22:52:57.512158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 774/1552] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:57 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:57.806479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b690bf48-a346-4036-9d32-e05568d121e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:57.808660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b690bf48-a346-4036-9d32-e05568d121e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:57.814955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b690bf48-a346-4036-9d32-e05568d121e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.815547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b690bf48-a346-4036-9d32-e05568d121e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.815989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b690bf48-a346-4036-9d32-e05568d121e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.816721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b690bf48-a346-4036-9d32-e05568d121e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.817193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b690bf48-a346-4036-9d32-e05568d121e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.817617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b690bf48-a346-4036-9d32-e05568d121e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.851716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b690bf48-a346-4036-9d32-e05568d121e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049368 Aug 29 22:52:57.852321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 779/1553] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:58.031107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ae71df91-24b2-446e-ac08-ae45712493a9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:58.033805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ae71df91-24b2-446e-ac08-ae45712493a9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:58.040566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae71df91-24b2-446e-ac08-ae45712493a9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.041059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae71df91-24b2-446e-ac08-ae45712493a9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.041497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae71df91-24b2-446e-ac08-ae45712493a9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.042204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae71df91-24b2-446e-ac08-ae45712493a9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.042662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae71df91-24b2-446e-ac08-ae45712493a9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.043127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae71df91-24b2-446e-ac08-ae45712493a9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.074134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ae71df91-24b2-446e-ac08-ae45712493a9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046882 Aug 29 22:52:58.074612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 775/1554] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:58.224447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2d7da3c3-45f7-4320-9359-3b79da6cd795 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:58.226620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2d7da3c3-45f7-4320-9359-3b79da6cd795 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:58.233225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d7da3c3-45f7-4320-9359-3b79da6cd795 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.233704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d7da3c3-45f7-4320-9359-3b79da6cd795 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.234134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d7da3c3-45f7-4320-9359-3b79da6cd795 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.234831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d7da3c3-45f7-4320-9359-3b79da6cd795 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.235282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d7da3c3-45f7-4320-9359-3b79da6cd795 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.235703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d7da3c3-45f7-4320-9359-3b79da6cd795 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.266590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2d7da3c3-45f7-4320-9359-3b79da6cd795 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047202 Aug 29 22:52:58.267148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 780/1555] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:58.532098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:58.532734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:58.539776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.540299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.540741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.541438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.541891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.542345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.609039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:58.617268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a852a578-ceea-4bb3-b260-ee6e574aa317 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089007 Aug 29 22:52:58.617848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 776/1556] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:58 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:58.864328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-adfcd5f5-6bce-45e1-b4b3-fe4d95a3c541 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:58.867592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-adfcd5f5-6bce-45e1-b4b3-fe4d95a3c541 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:58.873876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adfcd5f5-6bce-45e1-b4b3-fe4d95a3c541 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.874365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adfcd5f5-6bce-45e1-b4b3-fe4d95a3c541 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.874800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adfcd5f5-6bce-45e1-b4b3-fe4d95a3c541 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.875521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adfcd5f5-6bce-45e1-b4b3-fe4d95a3c541 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.875951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adfcd5f5-6bce-45e1-b4b3-fe4d95a3c541 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.876402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-adfcd5f5-6bce-45e1-b4b3-fe4d95a3c541 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.909008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-adfcd5f5-6bce-45e1-b4b3-fe4d95a3c541 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048728 Aug 29 22:52:58.909306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 781/1557] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:59.088461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-caab78e9-6745-4c7d-8641-eb338484109d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:59.091311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-caab78e9-6745-4c7d-8641-eb338484109d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:59.099049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caab78e9-6745-4c7d-8641-eb338484109d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.099536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caab78e9-6745-4c7d-8641-eb338484109d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.099978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caab78e9-6745-4c7d-8641-eb338484109d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.100895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caab78e9-6745-4c7d-8641-eb338484109d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.101325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caab78e9-6745-4c7d-8641-eb338484109d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.101752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-caab78e9-6745-4c7d-8641-eb338484109d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.134470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-caab78e9-6745-4c7d-8641-eb338484109d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050852 Aug 29 22:52:59.135115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 777/1558] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:59.279054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9195f146-9891-40ce-ac98-5442e0e8a279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:59.281375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9195f146-9891-40ce-ac98-5442e0e8a279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:59.289386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9195f146-9891-40ce-ac98-5442e0e8a279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.289882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9195f146-9891-40ce-ac98-5442e0e8a279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.290320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9195f146-9891-40ce-ac98-5442e0e8a279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.291058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9195f146-9891-40ce-ac98-5442e0e8a279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.291521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9195f146-9891-40ce-ac98-5442e0e8a279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.291945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9195f146-9891-40ce-ac98-5442e0e8a279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.310896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:59.326792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9195f146-9891-40ce-ac98-5442e0e8a279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051628 Aug 29 22:52:59.329448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 782/1559] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:59.638732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:59.639267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:59.646454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.646941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.647382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.648090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.648652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.648994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.712527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:59.721252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-121cb335-563a-45c9-8ab7-cb79fb7e1852 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085690 Aug 29 22:52:59.722059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 778/1560] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:59 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:59.925023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-23595ef4-6cce-470d-841d-15234375826f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:59.928077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-23595ef4-6cce-470d-841d-15234375826f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:59.935427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23595ef4-6cce-470d-841d-15234375826f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.935935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23595ef4-6cce-470d-841d-15234375826f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.936380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23595ef4-6cce-470d-841d-15234375826f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.937077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23595ef4-6cce-470d-841d-15234375826f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.937524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23595ef4-6cce-470d-841d-15234375826f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.937943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23595ef4-6cce-470d-841d-15234375826f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.969750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-23595ef4-6cce-470d-841d-15234375826f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051840 Aug 29 22:52:59.970451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 783/1561] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:00.147346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0c31595c-306c-432f-be98-3a82a90e55d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:00.149586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0c31595c-306c-432f-be98-3a82a90e55d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:00.156075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c31595c-306c-432f-be98-3a82a90e55d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.156598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c31595c-306c-432f-be98-3a82a90e55d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.157038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c31595c-306c-432f-be98-3a82a90e55d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.157735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c31595c-306c-432f-be98-3a82a90e55d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.158273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c31595c-306c-432f-be98-3a82a90e55d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.158702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c31595c-306c-432f-be98-3a82a90e55d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.191452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0c31595c-306c-432f-be98-3a82a90e55d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048751 Aug 29 22:53:00.191946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 779/1562] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:00.340872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bf8ca96f-b11e-45cb-ad46-09018d3fb390 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:00.343005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bf8ca96f-b11e-45cb-ad46-09018d3fb390 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:00.350443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf8ca96f-b11e-45cb-ad46-09018d3fb390 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.350931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf8ca96f-b11e-45cb-ad46-09018d3fb390 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.351359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf8ca96f-b11e-45cb-ad46-09018d3fb390 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.352060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf8ca96f-b11e-45cb-ad46-09018d3fb390 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.352535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf8ca96f-b11e-45cb-ad46-09018d3fb390 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.352955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf8ca96f-b11e-45cb-ad46-09018d3fb390 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.384035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bf8ca96f-b11e-45cb-ad46-09018d3fb390 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 Aug 29 22:53:00.384647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 784/1563] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:00.741543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:00.742151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:00.748185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.748668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.749103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.749794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.750249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.750672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.815847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:00.824390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-67391561-7bf2-4b28-bb20-3d14a0aa6263 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086650 Aug 29 22:53:00.824969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 780/1564] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:00 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:00.983372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c64d6344-98a0-40be-9d88-58649d34f61e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:00.985588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c64d6344-98a0-40be-9d88-58649d34f61e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:00.991943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c64d6344-98a0-40be-9d88-58649d34f61e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.992394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c64d6344-98a0-40be-9d88-58649d34f61e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.992824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c64d6344-98a0-40be-9d88-58649d34f61e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.993517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c64d6344-98a0-40be-9d88-58649d34f61e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.993966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c64d6344-98a0-40be-9d88-58649d34f61e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.994394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c64d6344-98a0-40be-9d88-58649d34f61e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.026424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c64d6344-98a0-40be-9d88-58649d34f61e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047037 Aug 29 22:53:01.026999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 785/1565] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:01.203131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ebc64020-fda9-4b56-8aba-4a060d413937 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:01.205655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ebc64020-fda9-4b56-8aba-4a060d413937 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:01.212441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebc64020-fda9-4b56-8aba-4a060d413937 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.212923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebc64020-fda9-4b56-8aba-4a060d413937 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.213352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebc64020-fda9-4b56-8aba-4a060d413937 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.214050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebc64020-fda9-4b56-8aba-4a060d413937 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.214515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebc64020-fda9-4b56-8aba-4a060d413937 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.214937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebc64020-fda9-4b56-8aba-4a060d413937 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.246562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ebc64020-fda9-4b56-8aba-4a060d413937 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047450 Aug 29 22:53:01.247034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 781/1566] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:01.396726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8bdbdce5-7d15-43a5-9b8b-7debcc3f08b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:01.398882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8bdbdce5-7d15-43a5-9b8b-7debcc3f08b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:01.405904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8bdbdce5-7d15-43a5-9b8b-7debcc3f08b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.405904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8bdbdce5-7d15-43a5-9b8b-7debcc3f08b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.406756 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8bdbdce5-7d15-43a5-9b8b-7debcc3f08b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.407454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8bdbdce5-7d15-43a5-9b8b-7debcc3f08b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.407907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8bdbdce5-7d15-43a5-9b8b-7debcc3f08b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.408369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8bdbdce5-7d15-43a5-9b8b-7debcc3f08b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.440026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8bdbdce5-7d15-43a5-9b8b-7debcc3f08b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046804 Aug 29 22:53:01.440847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 786/1567] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:01.846661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:01.847320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:01.853629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.854146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.854710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.855364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.855818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.856279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.918345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:01.928033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-384011c0-6a73-4981-910e-ef828f65bbd3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085842 Aug 29 22:53:01.928671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 782/1568] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:01 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:02.039647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-47cc1071-9910-44c9-a298-9f604225673f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:02.041853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-47cc1071-9910-44c9-a298-9f604225673f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:02.047924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47cc1071-9910-44c9-a298-9f604225673f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.048445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47cc1071-9910-44c9-a298-9f604225673f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.049068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47cc1071-9910-44c9-a298-9f604225673f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.049933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47cc1071-9910-44c9-a298-9f604225673f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.050383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47cc1071-9910-44c9-a298-9f604225673f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.050804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47cc1071-9910-44c9-a298-9f604225673f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.081200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-47cc1071-9910-44c9-a298-9f604225673f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045239 Aug 29 22:53:02.081767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 787/1569] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:02.259166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ba1885e1-dd45-4922-af6d-04f979e2df54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:02.261373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ba1885e1-dd45-4922-af6d-04f979e2df54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:02.268772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba1885e1-dd45-4922-af6d-04f979e2df54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.269276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba1885e1-dd45-4922-af6d-04f979e2df54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.269711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba1885e1-dd45-4922-af6d-04f979e2df54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.270421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba1885e1-dd45-4922-af6d-04f979e2df54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.270879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba1885e1-dd45-4922-af6d-04f979e2df54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.271298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba1885e1-dd45-4922-af6d-04f979e2df54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.302818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ba1885e1-dd45-4922-af6d-04f979e2df54 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047752 Aug 29 22:53:02.303384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 783/1570] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:02.452879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2a0173a2-b60c-4f33-b61a-e59930fab038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:02.455937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2a0173a2-b60c-4f33-b61a-e59930fab038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:02.462434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a0173a2-b60c-4f33-b61a-e59930fab038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.462913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a0173a2-b60c-4f33-b61a-e59930fab038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.463353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a0173a2-b60c-4f33-b61a-e59930fab038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.464043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a0173a2-b60c-4f33-b61a-e59930fab038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.464533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a0173a2-b60c-4f33-b61a-e59930fab038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.464961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a0173a2-b60c-4f33-b61a-e59930fab038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.495942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2a0173a2-b60c-4f33-b61a-e59930fab038 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046944 Aug 29 22:53:02.496548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 788/1571] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:02.950381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:02.950990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:02.958157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.958645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.959085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.959786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.960288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.960722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.028942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:03.037709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-06bc06c2-70f0-416b-b739-e2c482faff00 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091261 Aug 29 22:53:03.038285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 784/1572] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:02 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:03.093393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-97f00c74-e3de-4033-90a0-9514e089dfaf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:03.095604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-97f00c74-e3de-4033-90a0-9514e089dfaf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:03.101819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f00c74-e3de-4033-90a0-9514e089dfaf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.102308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f00c74-e3de-4033-90a0-9514e089dfaf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.102746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f00c74-e3de-4033-90a0-9514e089dfaf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.103435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f00c74-e3de-4033-90a0-9514e089dfaf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.103992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f00c74-e3de-4033-90a0-9514e089dfaf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.104327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97f00c74-e3de-4033-90a0-9514e089dfaf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.135058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-97f00c74-e3de-4033-90a0-9514e089dfaf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045991 Aug 29 22:53:03.135644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 789/1573] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:03.315800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-520a2bd2-5640-4294-95dd-f3031507b3d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:03.318108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-520a2bd2-5640-4294-95dd-f3031507b3d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:03.324921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520a2bd2-5640-4294-95dd-f3031507b3d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.325402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520a2bd2-5640-4294-95dd-f3031507b3d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.325836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520a2bd2-5640-4294-95dd-f3031507b3d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.326539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520a2bd2-5640-4294-95dd-f3031507b3d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.326991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520a2bd2-5640-4294-95dd-f3031507b3d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.327415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520a2bd2-5640-4294-95dd-f3031507b3d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.357927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-520a2bd2-5640-4294-95dd-f3031507b3d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046755 Aug 29 22:53:03.358481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 785/1574] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:03.510085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9d937936-960c-4ae7-9e47-ae1fc9842a87 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:03.513115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9d937936-960c-4ae7-9e47-ae1fc9842a87 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:03.519948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d937936-960c-4ae7-9e47-ae1fc9842a87 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.520467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d937936-960c-4ae7-9e47-ae1fc9842a87 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.520933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d937936-960c-4ae7-9e47-ae1fc9842a87 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.521629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d937936-960c-4ae7-9e47-ae1fc9842a87 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.522084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d937936-960c-4ae7-9e47-ae1fc9842a87 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.522509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d937936-960c-4ae7-9e47-ae1fc9842a87 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.553266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9d937936-960c-4ae7-9e47-ae1fc9842a87 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047985 Aug 29 22:53:03.553843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 790/1575] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:04.058632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:04.059261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:04.065310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.065798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.066218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.066900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.067350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.067769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.130179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:04.138011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c2e96b3f-d078-45c4-9517-0a0a7484faaa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.083250 Aug 29 22:53:04.138571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 786/1576] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:04 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:04.148712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0822f228-0f44-4297-87a7-9a37f8a509cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:04.150861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0822f228-0f44-4297-87a7-9a37f8a509cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:04.156965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0822f228-0f44-4297-87a7-9a37f8a509cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.157440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0822f228-0f44-4297-87a7-9a37f8a509cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.158396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0822f228-0f44-4297-87a7-9a37f8a509cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.159086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0822f228-0f44-4297-87a7-9a37f8a509cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.159534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0822f228-0f44-4297-87a7-9a37f8a509cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.160055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0822f228-0f44-4297-87a7-9a37f8a509cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.191542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0822f228-0f44-4297-87a7-9a37f8a509cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046757 Aug 29 22:53:04.192368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 791/1577] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:04.371393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9048f1bc-fe46-4a53-816b-334c24ae65e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:04.373640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9048f1bc-fe46-4a53-816b-334c24ae65e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:04.380556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9048f1bc-fe46-4a53-816b-334c24ae65e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.380964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9048f1bc-fe46-4a53-816b-334c24ae65e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.381402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9048f1bc-fe46-4a53-816b-334c24ae65e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.382112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9048f1bc-fe46-4a53-816b-334c24ae65e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.382573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9048f1bc-fe46-4a53-816b-334c24ae65e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.383000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9048f1bc-fe46-4a53-816b-334c24ae65e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.410198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:04.416598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9048f1bc-fe46-4a53-816b-334c24ae65e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049795 Aug 29 22:53:04.417177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 787/1578] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:04.566562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c00b3f97-e832-44ed-a1e2-c65072d5aabb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:04.568802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c00b3f97-e832-44ed-a1e2-c65072d5aabb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:04.575194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c00b3f97-e832-44ed-a1e2-c65072d5aabb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.575667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c00b3f97-e832-44ed-a1e2-c65072d5aabb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.576095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c00b3f97-e832-44ed-a1e2-c65072d5aabb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.576814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c00b3f97-e832-44ed-a1e2-c65072d5aabb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.577260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c00b3f97-e832-44ed-a1e2-c65072d5aabb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.577682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c00b3f97-e832-44ed-a1e2-c65072d5aabb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.608445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c00b3f97-e832-44ed-a1e2-c65072d5aabb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046517 Aug 29 22:53:04.609006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 792/1579] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:05.158904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.159682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:05.166306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.166786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.167220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.167911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.168398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.168825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.205440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1c5ebb8e-a5db-4c6a-a1aa-34f783bd68fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.207648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1c5ebb8e-a5db-4c6a-a1aa-34f783bd68fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:05.213906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c5ebb8e-a5db-4c6a-a1aa-34f783bd68fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.214390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c5ebb8e-a5db-4c6a-a1aa-34f783bd68fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.214820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c5ebb8e-a5db-4c6a-a1aa-34f783bd68fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.215522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c5ebb8e-a5db-4c6a-a1aa-34f783bd68fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.215963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c5ebb8e-a5db-4c6a-a1aa-34f783bd68fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.216411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c5ebb8e-a5db-4c6a-a1aa-34f783bd68fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.234971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:05.244263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dd6a276a-28ae-427a-a4d9-992415ed79fc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089733 Aug 29 22:53:05.244866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 788/1580] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:05 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:05.249843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1c5ebb8e-a5db-4c6a-a1aa-34f783bd68fb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049247 Aug 29 22:53:05.250592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 793/1581] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:05.436224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eb77590b-c9de-4229-ae8a-fba6593ee263 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.438406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eb77590b-c9de-4229-ae8a-fba6593ee263 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:05.445608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb77590b-c9de-4229-ae8a-fba6593ee263 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.446094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb77590b-c9de-4229-ae8a-fba6593ee263 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.446531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb77590b-c9de-4229-ae8a-fba6593ee263 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.447227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb77590b-c9de-4229-ae8a-fba6593ee263 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.447684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb77590b-c9de-4229-ae8a-fba6593ee263 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.448105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb77590b-c9de-4229-ae8a-fba6593ee263 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.479784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eb77590b-c9de-4229-ae8a-fba6593ee263 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047608 Aug 29 22:53:05.480293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 789/1582] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:05 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:05.620543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b3eb0f3a-4eb5-47f6-ba80-669938f43e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.622845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b3eb0f3a-4eb5-47f6-ba80-669938f43e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:05.630250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3eb0f3a-4eb5-47f6-ba80-669938f43e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.630723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3eb0f3a-4eb5-47f6-ba80-669938f43e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.631155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3eb0f3a-4eb5-47f6-ba80-669938f43e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.631842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3eb0f3a-4eb5-47f6-ba80-669938f43e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.632323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3eb0f3a-4eb5-47f6-ba80-669938f43e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.632750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3eb0f3a-4eb5-47f6-ba80-669938f43e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.663198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b3eb0f3a-4eb5-47f6-ba80-669938f43e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046559 Aug 29 22:53:05.663707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 794/1583] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:06.263348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-813118bf-0612-4a50-8165-bd253b41854f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:06.265449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:06.266125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-813118bf-0612-4a50-8165-bd253b41854f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:06.266238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:06.272853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813118bf-0612-4a50-8165-bd253b41854f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.273289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.273429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813118bf-0612-4a50-8165-bd253b41854f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.273765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813118bf-0612-4a50-8165-bd253b41854f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.274642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.274642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.274844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813118bf-0612-4a50-8165-bd253b41854f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.274927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813118bf-0612-4a50-8165-bd253b41854f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.275031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.275332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813118bf-0612-4a50-8165-bd253b41854f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.275635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.276124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.309140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-813118bf-0612-4a50-8165-bd253b41854f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049749 Aug 29 22:53:06.310070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 790/1584] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:06.341334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:06.350000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1d05f98f-9033-4347-b8c3-d20dcdc78124 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088583 Aug 29 22:53:06.350586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 795/1585] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:06 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:06.493442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8938a7b0-c3fc-4eba-93d5-06cddd427e38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:06.495577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8938a7b0-c3fc-4eba-93d5-06cddd427e38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:06.503383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8938a7b0-c3fc-4eba-93d5-06cddd427e38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.506946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8938a7b0-c3fc-4eba-93d5-06cddd427e38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.506946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8938a7b0-c3fc-4eba-93d5-06cddd427e38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.506946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8938a7b0-c3fc-4eba-93d5-06cddd427e38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.506946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8938a7b0-c3fc-4eba-93d5-06cddd427e38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.507549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8938a7b0-c3fc-4eba-93d5-06cddd427e38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.538312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8938a7b0-c3fc-4eba-93d5-06cddd427e38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048679 Aug 29 22:53:06.538790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 791/1586] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:06.676574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-274e49d2-2ebf-4cc7-b1bb-47167f2d00f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:06.678722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-274e49d2-2ebf-4cc7-b1bb-47167f2d00f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:06.685266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274e49d2-2ebf-4cc7-b1bb-47167f2d00f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.685747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274e49d2-2ebf-4cc7-b1bb-47167f2d00f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.686176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274e49d2-2ebf-4cc7-b1bb-47167f2d00f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.686869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274e49d2-2ebf-4cc7-b1bb-47167f2d00f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.687320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274e49d2-2ebf-4cc7-b1bb-47167f2d00f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.687744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274e49d2-2ebf-4cc7-b1bb-47167f2d00f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.719254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-274e49d2-2ebf-4cc7-b1bb-47167f2d00f2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047566 Aug 29 22:53:06.719813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 796/1587] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:07.323254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-737b369e-871b-4af3-b24a-4cf3ae05ecce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:07.325525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-737b369e-871b-4af3-b24a-4cf3ae05ecce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:07.332679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-737b369e-871b-4af3-b24a-4cf3ae05ecce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.333162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-737b369e-871b-4af3-b24a-4cf3ae05ecce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.333588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-737b369e-871b-4af3-b24a-4cf3ae05ecce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.334281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-737b369e-871b-4af3-b24a-4cf3ae05ecce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.334724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-737b369e-871b-4af3-b24a-4cf3ae05ecce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.335140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-737b369e-871b-4af3-b24a-4cf3ae05ecce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.367711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-737b369e-871b-4af3-b24a-4cf3ae05ecce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048611 Aug 29 22:53:07.368328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 792/1588] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:07.374702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:07.375662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:07.382138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.382625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.383055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.383861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.384380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.384791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.450542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:07.459964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e35bc108-41da-4588-ba20-4a750b970f29 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092135 Aug 29 22:53:07.460604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 797/1589] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:07 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:07.550775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a26c1ee3-01ec-4883-b137-29f30562a43c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:07.552917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a26c1ee3-01ec-4883-b137-29f30562a43c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:07.559346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a26c1ee3-01ec-4883-b137-29f30562a43c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.559821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a26c1ee3-01ec-4883-b137-29f30562a43c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.560278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a26c1ee3-01ec-4883-b137-29f30562a43c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.560967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a26c1ee3-01ec-4883-b137-29f30562a43c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.561414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a26c1ee3-01ec-4883-b137-29f30562a43c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.561835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a26c1ee3-01ec-4883-b137-29f30562a43c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.593781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a26c1ee3-01ec-4883-b137-29f30562a43c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047219 Aug 29 22:53:07.594349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 793/1590] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:07.731962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-56aeb803-9f7f-434c-ae82-5ef371323b36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:07.734178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-56aeb803-9f7f-434c-ae82-5ef371323b36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:07.741107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56aeb803-9f7f-434c-ae82-5ef371323b36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.741587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56aeb803-9f7f-434c-ae82-5ef371323b36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.742024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56aeb803-9f7f-434c-ae82-5ef371323b36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.742716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56aeb803-9f7f-434c-ae82-5ef371323b36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.743167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56aeb803-9f7f-434c-ae82-5ef371323b36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.743588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56aeb803-9f7f-434c-ae82-5ef371323b36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.776017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-56aeb803-9f7f-434c-ae82-5ef371323b36 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048012 Aug 29 22:53:07.776635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 798/1591] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:08.383857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-25d1f5c2-c213-4110-95c9-5e266e1c09e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:08.386052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-25d1f5c2-c213-4110-95c9-5e266e1c09e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:08.392994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25d1f5c2-c213-4110-95c9-5e266e1c09e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.393479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25d1f5c2-c213-4110-95c9-5e266e1c09e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.393917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25d1f5c2-c213-4110-95c9-5e266e1c09e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.394628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25d1f5c2-c213-4110-95c9-5e266e1c09e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.395081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25d1f5c2-c213-4110-95c9-5e266e1c09e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.395505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25d1f5c2-c213-4110-95c9-5e266e1c09e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.428858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-25d1f5c2-c213-4110-95c9-5e266e1c09e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048932 Aug 29 22:53:08.429444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 794/1592] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:08.481602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:08.482194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:08.488631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.492835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.492835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.492835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.492835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.493235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.495322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:08.558121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:08.568372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8b2fac03-9268-4b52-9766-9d8c7e0b2807 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090506 Aug 29 22:53:08.568985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 799/1593] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:08 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:08.606307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ccd56efe-d8d4-475a-8412-43a1300adaae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:08.608499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ccd56efe-d8d4-475a-8412-43a1300adaae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:08.615459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd56efe-d8d4-475a-8412-43a1300adaae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.615936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd56efe-d8d4-475a-8412-43a1300adaae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.616402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd56efe-d8d4-475a-8412-43a1300adaae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.617096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd56efe-d8d4-475a-8412-43a1300adaae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.617543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd56efe-d8d4-475a-8412-43a1300adaae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.617961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccd56efe-d8d4-475a-8412-43a1300adaae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.649815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ccd56efe-d8d4-475a-8412-43a1300adaae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047325 Aug 29 22:53:08.650288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 795/1594] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:08.791706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3b299cfd-feaa-4896-b4bd-c9b4486b7908 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:08.793903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3b299cfd-feaa-4896-b4bd-c9b4486b7908 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:08.802692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b299cfd-feaa-4896-b4bd-c9b4486b7908 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.803190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b299cfd-feaa-4896-b4bd-c9b4486b7908 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.803627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b299cfd-feaa-4896-b4bd-c9b4486b7908 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.804372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b299cfd-feaa-4896-b4bd-c9b4486b7908 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.804825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b299cfd-feaa-4896-b4bd-c9b4486b7908 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.805249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b299cfd-feaa-4896-b4bd-c9b4486b7908 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.840065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3b299cfd-feaa-4896-b4bd-c9b4486b7908 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052458 Aug 29 22:53:08.840659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 800/1595] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:09.441679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-75aa3347-12a0-46ed-a649-041bdc6b9383 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:09.443887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-75aa3347-12a0-46ed-a649-041bdc6b9383 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:09.450227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75aa3347-12a0-46ed-a649-041bdc6b9383 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.450727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75aa3347-12a0-46ed-a649-041bdc6b9383 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.451162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75aa3347-12a0-46ed-a649-041bdc6b9383 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.451874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75aa3347-12a0-46ed-a649-041bdc6b9383 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.452356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75aa3347-12a0-46ed-a649-041bdc6b9383 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.452904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75aa3347-12a0-46ed-a649-041bdc6b9383 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.487522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-75aa3347-12a0-46ed-a649-041bdc6b9383 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049953 Aug 29 22:53:09.488199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 796/1596] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:09.590585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:09.591243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:09.597879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.598356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.598783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.599468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.599912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.600369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.664272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1c0ad349-b3c4-48af-ac10-2830bf7b9cd9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:09.665789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:09.666644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1c0ad349-b3c4-48af-ac10-2830bf7b9cd9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:09.673069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c0ad349-b3c4-48af-ac10-2830bf7b9cd9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.673609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c0ad349-b3c4-48af-ac10-2830bf7b9cd9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.673990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c0ad349-b3c4-48af-ac10-2830bf7b9cd9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.674688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c0ad349-b3c4-48af-ac10-2830bf7b9cd9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.675119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b4db96f5-cf0e-4638-86c5-169b52dd44e3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088274 Aug 29 22:53:09.675247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c0ad349-b3c4-48af-ac10-2830bf7b9cd9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.675540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c0ad349-b3c4-48af-ac10-2830bf7b9cd9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.676504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 801/1597] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:09 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:09.710684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1c0ad349-b3c4-48af-ac10-2830bf7b9cd9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052300 Aug 29 22:53:09.711171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 797/1598] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:09 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:09.852727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c2a747ec-408c-42ee-9192-2b254c416fed tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:09.854916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c2a747ec-408c-42ee-9192-2b254c416fed tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:09.861441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2a747ec-408c-42ee-9192-2b254c416fed tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.862005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2a747ec-408c-42ee-9192-2b254c416fed tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.862435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2a747ec-408c-42ee-9192-2b254c416fed tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.863123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2a747ec-408c-42ee-9192-2b254c416fed tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.863569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2a747ec-408c-42ee-9192-2b254c416fed tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.863982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2a747ec-408c-42ee-9192-2b254c416fed tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.896717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c2a747ec-408c-42ee-9192-2b254c416fed tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047818 Aug 29 22:53:09.897301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 802/1599] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:10.500562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-391f5484-64b0-42be-954f-dccb021a3b87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:10.503640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-391f5484-64b0-42be-954f-dccb021a3b87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:10.509726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-391f5484-64b0-42be-954f-dccb021a3b87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.510203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-391f5484-64b0-42be-954f-dccb021a3b87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.510639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-391f5484-64b0-42be-954f-dccb021a3b87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.511790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-391f5484-64b0-42be-954f-dccb021a3b87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.511790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-391f5484-64b0-42be-954f-dccb021a3b87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.512355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-391f5484-64b0-42be-954f-dccb021a3b87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.545074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-391f5484-64b0-42be-954f-dccb021a3b87 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048470 Aug 29 22:53:10.545647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 798/1600] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:10.698078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:10.698697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:10.705771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.706277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.706710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.707433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.707877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.708334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.723044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-409078e6-b6dc-4f0d-b720-8ba7b14db98d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:10.725660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-409078e6-b6dc-4f0d-b720-8ba7b14db98d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:10.732184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-409078e6-b6dc-4f0d-b720-8ba7b14db98d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.732670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-409078e6-b6dc-4f0d-b720-8ba7b14db98d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.733106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-409078e6-b6dc-4f0d-b720-8ba7b14db98d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.733803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-409078e6-b6dc-4f0d-b720-8ba7b14db98d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.734311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-409078e6-b6dc-4f0d-b720-8ba7b14db98d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.734731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-409078e6-b6dc-4f0d-b720-8ba7b14db98d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.766730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-409078e6-b6dc-4f0d-b720-8ba7b14db98d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047519 Aug 29 22:53:10.772419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 799/1601] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:10.773116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:10.780085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dcf57580-4029-44b9-826e-72e828bee85e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085916 Aug 29 22:53:10.780673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 803/1602] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:10 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:10.909572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-73dbc858-0722-4230-b203-02aa3115d980 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:10.911750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-73dbc858-0722-4230-b203-02aa3115d980 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:10.918734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73dbc858-0722-4230-b203-02aa3115d980 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.919220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73dbc858-0722-4230-b203-02aa3115d980 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.919654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73dbc858-0722-4230-b203-02aa3115d980 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.920395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73dbc858-0722-4230-b203-02aa3115d980 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.921228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73dbc858-0722-4230-b203-02aa3115d980 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.921228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73dbc858-0722-4230-b203-02aa3115d980 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.953303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-73dbc858-0722-4230-b203-02aa3115d980 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047683 Aug 29 22:53:10.956242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 800/1603] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:11.558060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1dc435c2-fde2-4458-afcb-18b148105c73 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:11.560208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1dc435c2-fde2-4458-afcb-18b148105c73 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:11.566869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1dc435c2-fde2-4458-afcb-18b148105c73 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.567336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1dc435c2-fde2-4458-afcb-18b148105c73 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.567761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1dc435c2-fde2-4458-afcb-18b148105c73 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.568480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1dc435c2-fde2-4458-afcb-18b148105c73 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.568924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1dc435c2-fde2-4458-afcb-18b148105c73 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.569412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1dc435c2-fde2-4458-afcb-18b148105c73 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.601152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1dc435c2-fde2-4458-afcb-18b148105c73 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047172 Aug 29 22:53:11.601731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 804/1604] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:11.780489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2e6d7673-ce57-49e9-91b5-43403518fca3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:11.782687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2e6d7673-ce57-49e9-91b5-43403518fca3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:11.789418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e6d7673-ce57-49e9-91b5-43403518fca3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.789890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e6d7673-ce57-49e9-91b5-43403518fca3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.790320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e6d7673-ce57-49e9-91b5-43403518fca3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.791013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e6d7673-ce57-49e9-91b5-43403518fca3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.791455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e6d7673-ce57-49e9-91b5-43403518fca3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.791878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e6d7673-ce57-49e9-91b5-43403518fca3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.801458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:11.802062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:11.808007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.808579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.808958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.809648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.810092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.810509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.824568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2e6d7673-ce57-49e9-91b5-43403518fca3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047945 Aug 29 22:53:11.825150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 801/1605] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:11 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:11.874322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:11.882689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-74ccc61a-8eef-4e8d-a75c-523eca1a0ecc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085765 Aug 29 22:53:11.883267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 805/1606] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:11 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:11.966574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dab5a39f-55b0-44e0-9f50-69c9ce18f59d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:11.968801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dab5a39f-55b0-44e0-9f50-69c9ce18f59d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:11.976254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dab5a39f-55b0-44e0-9f50-69c9ce18f59d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.976742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dab5a39f-55b0-44e0-9f50-69c9ce18f59d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.977183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dab5a39f-55b0-44e0-9f50-69c9ce18f59d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.977917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dab5a39f-55b0-44e0-9f50-69c9ce18f59d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.978369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dab5a39f-55b0-44e0-9f50-69c9ce18f59d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.978792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dab5a39f-55b0-44e0-9f50-69c9ce18f59d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.010444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dab5a39f-55b0-44e0-9f50-69c9ce18f59d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047816 Aug 29 22:53:12.011025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 802/1607] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:12.614250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5f05fcd9-716c-4c1b-ba6e-6916e094e3d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:12.616449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5f05fcd9-716c-4c1b-ba6e-6916e094e3d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:12.622996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f05fcd9-716c-4c1b-ba6e-6916e094e3d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.623476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f05fcd9-716c-4c1b-ba6e-6916e094e3d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.623910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f05fcd9-716c-4c1b-ba6e-6916e094e3d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.624633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f05fcd9-716c-4c1b-ba6e-6916e094e3d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.625083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f05fcd9-716c-4c1b-ba6e-6916e094e3d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.625506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f05fcd9-716c-4c1b-ba6e-6916e094e3d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.656405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5f05fcd9-716c-4c1b-ba6e-6916e094e3d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046412 Aug 29 22:53:12.656895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 806/1608] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:12.837208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ff88c445-35f0-483d-b1d1-602f4eadfd72 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:12.839375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ff88c445-35f0-483d-b1d1-602f4eadfd72 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:12.845868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff88c445-35f0-483d-b1d1-602f4eadfd72 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.846371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff88c445-35f0-483d-b1d1-602f4eadfd72 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.846803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff88c445-35f0-483d-b1d1-602f4eadfd72 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.847493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff88c445-35f0-483d-b1d1-602f4eadfd72 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.847937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff88c445-35f0-483d-b1d1-602f4eadfd72 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.848391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff88c445-35f0-483d-b1d1-602f4eadfd72 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.879357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ff88c445-35f0-483d-b1d1-602f4eadfd72 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046039 Aug 29 22:53:12.879923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 803/1609] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:12.902860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:12.903472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:12.916758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.916758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.916758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.916758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.917241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.917241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.980396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:12.988661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-13bc91bf-4230-4c07-9a13-f58f69e74b25 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089603 Aug 29 22:53:12.989236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 807/1610] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:12 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:13.024562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e08f0431-63ca-4ef9-9ba7-ba4b91a8e133 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:13.026790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e08f0431-63ca-4ef9-9ba7-ba4b91a8e133 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:13.033501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e08f0431-63ca-4ef9-9ba7-ba4b91a8e133 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.033992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e08f0431-63ca-4ef9-9ba7-ba4b91a8e133 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.034434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e08f0431-63ca-4ef9-9ba7-ba4b91a8e133 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.035138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e08f0431-63ca-4ef9-9ba7-ba4b91a8e133 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.035592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e08f0431-63ca-4ef9-9ba7-ba4b91a8e133 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.036016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e08f0431-63ca-4ef9-9ba7-ba4b91a8e133 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.051098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:13.068701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e08f0431-63ca-4ef9-9ba7-ba4b91a8e133 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049104 Aug 29 22:53:13.069280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 804/1611] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:13.669697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e6fe04de-a08d-485f-a0df-736e64f9100e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:13.671842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e6fe04de-a08d-485f-a0df-736e64f9100e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:13.678646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6fe04de-a08d-485f-a0df-736e64f9100e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.679043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6fe04de-a08d-485f-a0df-736e64f9100e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.679466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6fe04de-a08d-485f-a0df-736e64f9100e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.680177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6fe04de-a08d-485f-a0df-736e64f9100e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.680627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6fe04de-a08d-485f-a0df-736e64f9100e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.681036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e6fe04de-a08d-485f-a0df-736e64f9100e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.715503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e6fe04de-a08d-485f-a0df-736e64f9100e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049758 Aug 29 22:53:13.716081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 808/1612] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:13.891398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9e23602b-2417-444f-a3e0-552db132d29c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:13.894279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9e23602b-2417-444f-a3e0-552db132d29c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:13.901125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e23602b-2417-444f-a3e0-552db132d29c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.901601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e23602b-2417-444f-a3e0-552db132d29c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.902040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e23602b-2417-444f-a3e0-552db132d29c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.902725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e23602b-2417-444f-a3e0-552db132d29c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.903176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e23602b-2417-444f-a3e0-552db132d29c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.903590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e23602b-2417-444f-a3e0-552db132d29c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.936085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9e23602b-2417-444f-a3e0-552db132d29c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048860 Aug 29 22:53:13.936636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 805/1613] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:14.009690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:14.010294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:14.016324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.016802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.017296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.017983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.018419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.018893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.081898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d08eaa9b-049b-409c-aef2-c185ed5829f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:14.084164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d08eaa9b-049b-409c-aef2-c185ed5829f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:14.085672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:14.090363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d08eaa9b-049b-409c-aef2-c185ed5829f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.090845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d08eaa9b-049b-409c-aef2-c185ed5829f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.091281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d08eaa9b-049b-409c-aef2-c185ed5829f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.092036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d08eaa9b-049b-409c-aef2-c185ed5829f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.092468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d08eaa9b-049b-409c-aef2-c185ed5829f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.092913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d08eaa9b-049b-409c-aef2-c185ed5829f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.093584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ed0d86d8-fa66-4ea2-8fce-623b83fc48fb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087765 Aug 29 22:53:14.094166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 809/1614] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:14 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:14.124173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d08eaa9b-049b-409c-aef2-c185ed5829f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046813 Aug 29 22:53:14.141453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 806/1615] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:14.730950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2bd5de5a-81d6-4a40-a0ef-842286391663 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:14.733399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2bd5de5a-81d6-4a40-a0ef-842286391663 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:14.741570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bd5de5a-81d6-4a40-a0ef-842286391663 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.742214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bd5de5a-81d6-4a40-a0ef-842286391663 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.742745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bd5de5a-81d6-4a40-a0ef-842286391663 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.743739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bd5de5a-81d6-4a40-a0ef-842286391663 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.744346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bd5de5a-81d6-4a40-a0ef-842286391663 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.744867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bd5de5a-81d6-4a40-a0ef-842286391663 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.779414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2bd5de5a-81d6-4a40-a0ef-842286391663 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052362 Aug 29 22:53:14.780003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 810/1616] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:14.948642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bc87ecdd-c3f5-4605-94f5-f461cbdc8e7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:14.958769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bc87ecdd-c3f5-4605-94f5-f461cbdc8e7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:14.958769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc87ecdd-c3f5-4605-94f5-f461cbdc8e7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.959031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc87ecdd-c3f5-4605-94f5-f461cbdc8e7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.959490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc87ecdd-c3f5-4605-94f5-f461cbdc8e7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.960390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc87ecdd-c3f5-4605-94f5-f461cbdc8e7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.960847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc87ecdd-c3f5-4605-94f5-f461cbdc8e7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.961293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bc87ecdd-c3f5-4605-94f5-f461cbdc8e7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.992889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bc87ecdd-c3f5-4605-94f5-f461cbdc8e7d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048283 Aug 29 22:53:14.998718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 807/1617] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:15.114619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:15.115262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:15.121357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.121842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.122281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.122991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.123427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.123850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.152670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5e283b7b-82c9-4849-bfa0-568eca038a4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:15.154818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5e283b7b-82c9-4849-bfa0-568eca038a4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:15.162827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e283b7b-82c9-4849-bfa0-568eca038a4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.163316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e283b7b-82c9-4849-bfa0-568eca038a4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.163858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e283b7b-82c9-4849-bfa0-568eca038a4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.164554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e283b7b-82c9-4849-bfa0-568eca038a4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.165016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e283b7b-82c9-4849-bfa0-568eca038a4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.165452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e283b7b-82c9-4849-bfa0-568eca038a4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.190330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:15.200872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5e283b7b-82c9-4849-bfa0-568eca038a4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052148 Aug 29 22:53:15.201473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 808/1618] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:15.201703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1221b79b-8508-43db-b71e-d2b1b2bc53de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091425 Aug 29 22:53:15.202395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 811/1619] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:15 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:15.792632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-50ac782e-65ed-4845-8f28-7a4f24f6779b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:15.794771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-50ac782e-65ed-4845-8f28-7a4f24f6779b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:15.801940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ac782e-65ed-4845-8f28-7a4f24f6779b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.802430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ac782e-65ed-4845-8f28-7a4f24f6779b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.802868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ac782e-65ed-4845-8f28-7a4f24f6779b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.803570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ac782e-65ed-4845-8f28-7a4f24f6779b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.804027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ac782e-65ed-4845-8f28-7a4f24f6779b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.804479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ac782e-65ed-4845-8f28-7a4f24f6779b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.835111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-50ac782e-65ed-4845-8f28-7a4f24f6779b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046427 Aug 29 22:53:15.835691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 809/1620] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:16.005679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-95164995-4fc3-4edb-95e5-a6ed878c14a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:16.007833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-95164995-4fc3-4edb-95e5-a6ed878c14a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:16.014415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95164995-4fc3-4edb-95e5-a6ed878c14a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.014920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95164995-4fc3-4edb-95e5-a6ed878c14a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.015349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95164995-4fc3-4edb-95e5-a6ed878c14a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.016029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95164995-4fc3-4edb-95e5-a6ed878c14a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.016509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95164995-4fc3-4edb-95e5-a6ed878c14a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.016940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-95164995-4fc3-4edb-95e5-a6ed878c14a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.049495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-95164995-4fc3-4edb-95e5-a6ed878c14a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047899 Aug 29 22:53:16.049963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 812/1621] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:16.214000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8d80a59d-5c2b-456d-9590-bb734e61f587 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:16.216298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8d80a59d-5c2b-456d-9590-bb734e61f587 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:16.224339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d80a59d-5c2b-456d-9590-bb734e61f587 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.224835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d80a59d-5c2b-456d-9590-bb734e61f587 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.225088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:16.225662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d80a59d-5c2b-456d-9590-bb734e61f587 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.225772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:16.225973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d80a59d-5c2b-456d-9590-bb734e61f587 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.226430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d80a59d-5c2b-456d-9590-bb734e61f587 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.226859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d80a59d-5c2b-456d-9590-bb734e61f587 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.231956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.232553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.232992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.233681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.234137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.234559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.258187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8d80a59d-5c2b-456d-9590-bb734e61f587 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048186 Aug 29 22:53:16.258770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 810/1622] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:16.298710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:16.308064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-40818327-3c01-4b18-989d-20f8edcf72ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088042 Aug 29 22:53:16.308633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 813/1623] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:16 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:16.847559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9112cff0-b50b-42cd-b996-796a58ecd7a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:16.849881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9112cff0-b50b-42cd-b996-796a58ecd7a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:16.856006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9112cff0-b50b-42cd-b996-796a58ecd7a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.856518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9112cff0-b50b-42cd-b996-796a58ecd7a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.856954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9112cff0-b50b-42cd-b996-796a58ecd7a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.857649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9112cff0-b50b-42cd-b996-796a58ecd7a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.858099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9112cff0-b50b-42cd-b996-796a58ecd7a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.858528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9112cff0-b50b-42cd-b996-796a58ecd7a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.890395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9112cff0-b50b-42cd-b996-796a58ecd7a4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046774 Aug 29 22:53:16.890972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 811/1624] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:17.061935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e914c203-7aa6-4651-8954-d1b62a3a3077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:17.065017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e914c203-7aa6-4651-8954-d1b62a3a3077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:17.071809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e914c203-7aa6-4651-8954-d1b62a3a3077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.072327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e914c203-7aa6-4651-8954-d1b62a3a3077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.072762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e914c203-7aa6-4651-8954-d1b62a3a3077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.073453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e914c203-7aa6-4651-8954-d1b62a3a3077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.073906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e914c203-7aa6-4651-8954-d1b62a3a3077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.074328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e914c203-7aa6-4651-8954-d1b62a3a3077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.113099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e914c203-7aa6-4651-8954-d1b62a3a3077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047238 Aug 29 22:53:17.113099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 814/1625] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:17.270806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-50f4497c-fd41-42c0-af7a-e941cc5aa31e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:17.273244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-50f4497c-fd41-42c0-af7a-e941cc5aa31e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:17.281047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50f4497c-fd41-42c0-af7a-e941cc5aa31e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.281582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50f4497c-fd41-42c0-af7a-e941cc5aa31e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.282094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50f4497c-fd41-42c0-af7a-e941cc5aa31e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.283577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50f4497c-fd41-42c0-af7a-e941cc5aa31e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.284273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50f4497c-fd41-42c0-af7a-e941cc5aa31e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.284745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50f4497c-fd41-42c0-af7a-e941cc5aa31e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.316651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-50f4497c-fd41-42c0-af7a-e941cc5aa31e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049952 Aug 29 22:53:17.317224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 812/1626] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:17.330889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:17.331853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:17.333843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:17.338518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.343387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.343387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.343387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.343387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.343787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.405311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:17.409601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:17.414489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-62b60e25-d486-4463-ad4d-200cdd6f1b43 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087704 Aug 29 22:53:17.416343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 815/1627] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:17 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:17.903374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fb31dfc7-ffa7-493a-a553-3956e65482ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:17.905549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fb31dfc7-ffa7-493a-a553-3956e65482ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:17.912059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb31dfc7-ffa7-493a-a553-3956e65482ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.912573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb31dfc7-ffa7-493a-a553-3956e65482ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.913009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb31dfc7-ffa7-493a-a553-3956e65482ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.913739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb31dfc7-ffa7-493a-a553-3956e65482ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.914196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb31dfc7-ffa7-493a-a553-3956e65482ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.914621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb31dfc7-ffa7-493a-a553-3956e65482ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.946228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fb31dfc7-ffa7-493a-a553-3956e65482ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046880 Aug 29 22:53:17.946793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 813/1628] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:18.123025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ab026d9b-3bf1-460b-9bab-9ddb9bae33f2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:18.125202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ab026d9b-3bf1-460b-9bab-9ddb9bae33f2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:18.133067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab026d9b-3bf1-460b-9bab-9ddb9bae33f2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.133550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab026d9b-3bf1-460b-9bab-9ddb9bae33f2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.133983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab026d9b-3bf1-460b-9bab-9ddb9bae33f2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.134682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab026d9b-3bf1-460b-9bab-9ddb9bae33f2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.135132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab026d9b-3bf1-460b-9bab-9ddb9bae33f2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.135548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab026d9b-3bf1-460b-9bab-9ddb9bae33f2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.165707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ab026d9b-3bf1-460b-9bab-9ddb9bae33f2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Aug 29 22:53:18.166295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 816/1629] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:18.329208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0ac1d472-d9f2-423d-8753-90755c8d779d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:18.331862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0ac1d472-d9f2-423d-8753-90755c8d779d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:18.340035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ac1d472-d9f2-423d-8753-90755c8d779d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.340541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ac1d472-d9f2-423d-8753-90755c8d779d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.340972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ac1d472-d9f2-423d-8753-90755c8d779d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.341662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ac1d472-d9f2-423d-8753-90755c8d779d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.342113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ac1d472-d9f2-423d-8753-90755c8d779d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.342523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ac1d472-d9f2-423d-8753-90755c8d779d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.374491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0ac1d472-d9f2-423d-8753-90755c8d779d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049386 Aug 29 22:53:18.374967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 814/1630] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:18.436527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:18.437143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:18.443829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.444426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.444864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.445558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.446006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.446424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.510598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:18.519678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a55b3471-deec-4404-89ec-0e777110e4cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086631 Aug 29 22:53:18.519997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 817/1631] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:18 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:18.959577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9a4234e7-277f-492b-81f8-c9959a5f9501 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:18.962063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9a4234e7-277f-492b-81f8-c9959a5f9501 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:18.968080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a4234e7-277f-492b-81f8-c9959a5f9501 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.971307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a4234e7-277f-492b-81f8-c9959a5f9501 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.971307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a4234e7-277f-492b-81f8-c9959a5f9501 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.971307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a4234e7-277f-492b-81f8-c9959a5f9501 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.971307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a4234e7-277f-492b-81f8-c9959a5f9501 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.971712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a4234e7-277f-492b-81f8-c9959a5f9501 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.001636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9a4234e7-277f-492b-81f8-c9959a5f9501 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046412 Aug 29 22:53:19.002227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 815/1632] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:19.178685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3bb6fd76-915e-4ee8-871b-793cd8d7fcfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:19.180860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3bb6fd76-915e-4ee8-871b-793cd8d7fcfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:19.187530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd76-915e-4ee8-871b-793cd8d7fcfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.188012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd76-915e-4ee8-871b-793cd8d7fcfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.188483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd76-915e-4ee8-871b-793cd8d7fcfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.189868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd76-915e-4ee8-871b-793cd8d7fcfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.190323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd76-915e-4ee8-871b-793cd8d7fcfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.190749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3bb6fd76-915e-4ee8-871b-793cd8d7fcfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.221482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3bb6fd76-915e-4ee8-871b-793cd8d7fcfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046788 Aug 29 22:53:19.222172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 818/1633] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:19.387057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-377c43d7-ef25-4bd8-a6db-6e7d45581102 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:19.389252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-377c43d7-ef25-4bd8-a6db-6e7d45581102 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:19.396471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-377c43d7-ef25-4bd8-a6db-6e7d45581102 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.396961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-377c43d7-ef25-4bd8-a6db-6e7d45581102 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.397385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-377c43d7-ef25-4bd8-a6db-6e7d45581102 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.398116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-377c43d7-ef25-4bd8-a6db-6e7d45581102 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.398561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-377c43d7-ef25-4bd8-a6db-6e7d45581102 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.399396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-377c43d7-ef25-4bd8-a6db-6e7d45581102 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.430606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-377c43d7-ef25-4bd8-a6db-6e7d45581102 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047366 Aug 29 22:53:19.431109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 816/1634] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:19.540439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:19.541031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:19.547024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.547500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.547977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.549063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.549518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.549943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.613960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:19.621772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-85c5072f-8e5c-4d53-8886-22b9f73462ff tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085254 Aug 29 22:53:19.622349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 819/1635] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:19 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:20.014344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7ba13944-7bdf-496e-bc95-226cd99791f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:20.016507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7ba13944-7bdf-496e-bc95-226cd99791f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:20.023331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ba13944-7bdf-496e-bc95-226cd99791f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:20.023815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ba13944-7bdf-496e-bc95-226cd99791f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:20.024270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ba13944-7bdf-496e-bc95-226cd99791f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.024966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ba13944-7bdf-496e-bc95-226cd99791f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:20.025413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ba13944-7bdf-496e-bc95-226cd99791f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:20.025827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ba13944-7bdf-496e-bc95-226cd99791f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.056431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7ba13944-7bdf-496e-bc95-226cd99791f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046087 Aug 29 22:53:20.056985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 817/1636] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:20.234246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-36e918f8-cd7b-4090-a7f2-a7bcf569fa14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:20.236568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-36e918f8-cd7b-4090-a7f2-a7bcf569fa14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:20.243113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36e918f8-cd7b-4090-a7f2-a7bcf569fa14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:20.243590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36e918f8-cd7b-4090-a7f2-a7bcf569fa14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:20.244025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36e918f8-cd7b-4090-a7f2-a7bcf569fa14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.244744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36e918f8-cd7b-4090-a7f2-a7bcf569fa14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:20.245194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36e918f8-cd7b-4090-a7f2-a7bcf569fa14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:20.245613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36e918f8-cd7b-4090-a7f2-a7bcf569fa14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.277106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-36e918f8-cd7b-4090-a7f2-a7bcf569fa14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046958 Aug 29 22:53:20.277672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 820/1637] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:20.443422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-276d7688-f6d4-438c-b78f-1784c34f71e4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:20.445605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-276d7688-f6d4-438c-b78f-1784c34f71e4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:20.452035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-276d7688-f6d4-438c-b78f-1784c34f71e4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:20.452561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-276d7688-f6d4-438c-b78f-1784c34f71e4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:20.453001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-276d7688-f6d4-438c-b78f-1784c34f71e4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.453689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-276d7688-f6d4-438c-b78f-1784c34f71e4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:20.455104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-276d7688-f6d4-438c-b78f-1784c34f71e4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:20.455553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-276d7688-f6d4-438c-b78f-1784c34f71e4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.484949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-276d7688-f6d4-438c-b78f-1784c34f71e4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Aug 29 22:53:20.485465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 818/1638] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:20.644020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:20.644692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:20.650853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:20.651352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:20.651766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.652564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:20.653014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:20.653438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.715145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:20.723233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-253db86c-d777-436c-a52c-31b89bb54835 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084115 Aug 29 22:53:20.723801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 821/1639] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:20 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:21.069323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-30c607f0-ddaa-4255-bcd2-3fba2007b8e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:21.071466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-30c607f0-ddaa-4255-bcd2-3fba2007b8e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:21.077522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30c607f0-ddaa-4255-bcd2-3fba2007b8e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.078003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30c607f0-ddaa-4255-bcd2-3fba2007b8e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.078478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30c607f0-ddaa-4255-bcd2-3fba2007b8e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.079575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30c607f0-ddaa-4255-bcd2-3fba2007b8e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.080258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30c607f0-ddaa-4255-bcd2-3fba2007b8e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.080700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30c607f0-ddaa-4255-bcd2-3fba2007b8e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.110480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-30c607f0-ddaa-4255-bcd2-3fba2007b8e3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045051 Aug 29 22:53:21.111831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 819/1640] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:21.289271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5c6d65be-2589-4ba3-8c0a-0298b54e7c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:21.291362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5c6d65be-2589-4ba3-8c0a-0298b54e7c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:21.297680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c6d65be-2589-4ba3-8c0a-0298b54e7c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.299094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c6d65be-2589-4ba3-8c0a-0298b54e7c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.299595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c6d65be-2589-4ba3-8c0a-0298b54e7c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.300310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c6d65be-2589-4ba3-8c0a-0298b54e7c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.300755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c6d65be-2589-4ba3-8c0a-0298b54e7c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.301168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c6d65be-2589-4ba3-8c0a-0298b54e7c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.330494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5c6d65be-2589-4ba3-8c0a-0298b54e7c05 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Aug 29 22:53:21.331043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 822/1641] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:21 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:21.497870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4ae7d56c-a176-4cad-8cf2-1e27e7bc741c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:21.500024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4ae7d56c-a176-4cad-8cf2-1e27e7bc741c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:21.506250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ae7d56c-a176-4cad-8cf2-1e27e7bc741c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.506737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ae7d56c-a176-4cad-8cf2-1e27e7bc741c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.507177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ae7d56c-a176-4cad-8cf2-1e27e7bc741c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.507877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ae7d56c-a176-4cad-8cf2-1e27e7bc741c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.508372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ae7d56c-a176-4cad-8cf2-1e27e7bc741c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.508800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ae7d56c-a176-4cad-8cf2-1e27e7bc741c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.540346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4ae7d56c-a176-4cad-8cf2-1e27e7bc741c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Aug 29 22:53:21.540853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 820/1642] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:21.744622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:21.745259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:21.751552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.752308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.753063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.753751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.754213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.754634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.818867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:21.826592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-83bd6d55-1537-4fcc-8dc1-de20b5726c6a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086037 Aug 29 22:53:21.827155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 823/1643] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:21 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:22.123691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-28fb282f-b9bc-4749-ac4c-37c90a220d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:22.125852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-28fb282f-b9bc-4749-ac4c-37c90a220d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:22.132460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28fb282f-b9bc-4749-ac4c-37c90a220d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.132940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28fb282f-b9bc-4749-ac4c-37c90a220d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.133368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28fb282f-b9bc-4749-ac4c-37c90a220d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.134048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28fb282f-b9bc-4749-ac4c-37c90a220d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.134499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28fb282f-b9bc-4749-ac4c-37c90a220d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.134911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28fb282f-b9bc-4749-ac4c-37c90a220d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.137337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:22.165823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-28fb282f-b9bc-4749-ac4c-37c90a220d24 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046027 Aug 29 22:53:22.166382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 821/1644] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:22.342243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac05e313-26b6-4617-bc95-eddaee5f2d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:22.344395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac05e313-26b6-4617-bc95-eddaee5f2d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:22.350720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac05e313-26b6-4617-bc95-eddaee5f2d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.351196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac05e313-26b6-4617-bc95-eddaee5f2d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.351632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac05e313-26b6-4617-bc95-eddaee5f2d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.352348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac05e313-26b6-4617-bc95-eddaee5f2d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.352804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac05e313-26b6-4617-bc95-eddaee5f2d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.353228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac05e313-26b6-4617-bc95-eddaee5f2d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.385230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac05e313-26b6-4617-bc95-eddaee5f2d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046830 Aug 29 22:53:22.385716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 824/1645] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:22.553872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-67648501-ebf3-4130-bc5b-46bc316d8003 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:22.556021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-67648501-ebf3-4130-bc5b-46bc316d8003 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:22.557839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:22.563517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67648501-ebf3-4130-bc5b-46bc316d8003 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.564249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67648501-ebf3-4130-bc5b-46bc316d8003 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.564811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67648501-ebf3-4130-bc5b-46bc316d8003 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.565549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67648501-ebf3-4130-bc5b-46bc316d8003 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.566009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67648501-ebf3-4130-bc5b-46bc316d8003 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.566463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67648501-ebf3-4130-bc5b-46bc316d8003 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.603040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-67648501-ebf3-4130-bc5b-46bc316d8003 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053696 Aug 29 22:53:22.603764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 822/1646] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:22.848215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:22.848775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:22.855219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.855696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.856127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.856841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.857287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.857707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.926143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:22.934829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-107c5b03-f222-41e5-a7cf-bb5286de3816 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090629 Aug 29 22:53:22.935419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 825/1647] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:22 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:23.179532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f12dfef2-6f07-434b-bc34-0661cb0620cb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:23.181796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f12dfef2-6f07-434b-bc34-0661cb0620cb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:23.187918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f12dfef2-6f07-434b-bc34-0661cb0620cb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.188552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f12dfef2-6f07-434b-bc34-0661cb0620cb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.189525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f12dfef2-6f07-434b-bc34-0661cb0620cb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.190222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f12dfef2-6f07-434b-bc34-0661cb0620cb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.190675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f12dfef2-6f07-434b-bc34-0661cb0620cb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.191102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f12dfef2-6f07-434b-bc34-0661cb0620cb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.222250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f12dfef2-6f07-434b-bc34-0661cb0620cb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047109 Aug 29 22:53:23.222821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 823/1648] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:23.396894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a76b617f-9a0a-451e-a2ef-cf09a2287fd4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:23.399057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a76b617f-9a0a-451e-a2ef-cf09a2287fd4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:23.405278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a76b617f-9a0a-451e-a2ef-cf09a2287fd4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.405763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a76b617f-9a0a-451e-a2ef-cf09a2287fd4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.406194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a76b617f-9a0a-451e-a2ef-cf09a2287fd4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.406887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a76b617f-9a0a-451e-a2ef-cf09a2287fd4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.407913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a76b617f-9a0a-451e-a2ef-cf09a2287fd4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.408646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a76b617f-9a0a-451e-a2ef-cf09a2287fd4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.440649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a76b617f-9a0a-451e-a2ef-cf09a2287fd4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047591 Aug 29 22:53:23.441128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 826/1649] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:23.618848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4f7f692b-5f80-4275-a632-338909f15bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:23.621761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4f7f692b-5f80-4275-a632-338909f15bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:23.628666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f7f692b-5f80-4275-a632-338909f15bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.629150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f7f692b-5f80-4275-a632-338909f15bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.629590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f7f692b-5f80-4275-a632-338909f15bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.630280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f7f692b-5f80-4275-a632-338909f15bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.630736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f7f692b-5f80-4275-a632-338909f15bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.631175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f7f692b-5f80-4275-a632-338909f15bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.662330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4f7f692b-5f80-4275-a632-338909f15bc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049001 Aug 29 22:53:23.662912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 824/1650] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:23.957358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:23.957936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:23.964663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.965144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.965581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.966316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.966809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.967233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.030248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:24.038641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c78d0e8f-4502-4d3b-85b4-1f2ab122a948 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086048 Aug 29 22:53:24.039210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 827/1651] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:23 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:24.234874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-40b0d68f-c1b4-474a-a3dc-1833976d9c04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:24.237204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-40b0d68f-c1b4-474a-a3dc-1833976d9c04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:24.243791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40b0d68f-c1b4-474a-a3dc-1833976d9c04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.244321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40b0d68f-c1b4-474a-a3dc-1833976d9c04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.244763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40b0d68f-c1b4-474a-a3dc-1833976d9c04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.245467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40b0d68f-c1b4-474a-a3dc-1833976d9c04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.245922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40b0d68f-c1b4-474a-a3dc-1833976d9c04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.246347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-40b0d68f-c1b4-474a-a3dc-1833976d9c04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.278270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-40b0d68f-c1b4-474a-a3dc-1833976d9c04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047421 Aug 29 22:53:24.278837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 825/1652] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:24.452318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-00ad6cdd-fb57-41fa-a154-9d407d2f91c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:24.455117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-00ad6cdd-fb57-41fa-a154-9d407d2f91c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:24.461395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ad6cdd-fb57-41fa-a154-9d407d2f91c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.461883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ad6cdd-fb57-41fa-a154-9d407d2f91c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.462312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ad6cdd-fb57-41fa-a154-9d407d2f91c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.463007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ad6cdd-fb57-41fa-a154-9d407d2f91c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.463454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ad6cdd-fb57-41fa-a154-9d407d2f91c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.463875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00ad6cdd-fb57-41fa-a154-9d407d2f91c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.494982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-00ad6cdd-fb57-41fa-a154-9d407d2f91c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046483 Aug 29 22:53:24.495421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 828/1653] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:24.674451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c4d35f1f-bf50-410a-9676-758501511ecf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:24.676707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c4d35f1f-bf50-410a-9676-758501511ecf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:24.683237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d35f1f-bf50-410a-9676-758501511ecf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.683719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d35f1f-bf50-410a-9676-758501511ecf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.684187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d35f1f-bf50-410a-9676-758501511ecf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.684892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d35f1f-bf50-410a-9676-758501511ecf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.685348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d35f1f-bf50-410a-9676-758501511ecf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.685776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d35f1f-bf50-410a-9676-758501511ecf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.717113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c4d35f1f-bf50-410a-9676-758501511ecf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Aug 29 22:53:24.717691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 826/1654] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:25.059274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:25.059807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:25.066930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.067414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.067846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.068640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.069091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.069514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.134368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:25.143228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e118e59a-5406-43f2-adc9-e87323ba9276 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087871 Aug 29 22:53:25.143859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 829/1655] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:25.290980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a550f95a-97e2-45c4-a63f-1b51c286f1f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:25.293159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a550f95a-97e2-45c4-a63f-1b51c286f1f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:25.300260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a550f95a-97e2-45c4-a63f-1b51c286f1f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.300745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a550f95a-97e2-45c4-a63f-1b51c286f1f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.301214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a550f95a-97e2-45c4-a63f-1b51c286f1f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.301908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a550f95a-97e2-45c4-a63f-1b51c286f1f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.302392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a550f95a-97e2-45c4-a63f-1b51c286f1f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.302809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a550f95a-97e2-45c4-a63f-1b51c286f1f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.334345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a550f95a-97e2-45c4-a63f-1b51c286f1f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047243 Aug 29 22:53:25.334834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 827/1656] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:25.509448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-99bd522b-5687-462c-ad19-444f478ec6b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:25.511596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-99bd522b-5687-462c-ad19-444f478ec6b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:25.517828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99bd522b-5687-462c-ad19-444f478ec6b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.518312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99bd522b-5687-462c-ad19-444f478ec6b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.518733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99bd522b-5687-462c-ad19-444f478ec6b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.519422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99bd522b-5687-462c-ad19-444f478ec6b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.519863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99bd522b-5687-462c-ad19-444f478ec6b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.520317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99bd522b-5687-462c-ad19-444f478ec6b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.550634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-99bd522b-5687-462c-ad19-444f478ec6b6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Aug 29 22:53:25.551192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 830/1657] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:25.730136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f8e85a05-20e2-4886-9cd6-b3666a750b78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:25.732401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f8e85a05-20e2-4886-9cd6-b3666a750b78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:25.740078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8e85a05-20e2-4886-9cd6-b3666a750b78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.740581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8e85a05-20e2-4886-9cd6-b3666a750b78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.741010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8e85a05-20e2-4886-9cd6-b3666a750b78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.741705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8e85a05-20e2-4886-9cd6-b3666a750b78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.742150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8e85a05-20e2-4886-9cd6-b3666a750b78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.742567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8e85a05-20e2-4886-9cd6-b3666a750b78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.773729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f8e85a05-20e2-4886-9cd6-b3666a750b78 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047464 Aug 29 22:53:25.774287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 828/1658] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:26.165166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:26.165802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:26.172446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.173528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.173960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.174639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.175097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.175496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.239512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:26.247367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0f92d7a9-facc-4a34-aad3-fb4e5a0f5507 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085996 Aug 29 22:53:26.247956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 831/1659] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:26.348227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cdd0d28c-3f86-40a4-b91d-3b512f8c7099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:26.350495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cdd0d28c-3f86-40a4-b91d-3b512f8c7099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:26.356542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdd0d28c-3f86-40a4-b91d-3b512f8c7099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.357076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdd0d28c-3f86-40a4-b91d-3b512f8c7099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.357485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdd0d28c-3f86-40a4-b91d-3b512f8c7099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.358173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdd0d28c-3f86-40a4-b91d-3b512f8c7099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.358627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdd0d28c-3f86-40a4-b91d-3b512f8c7099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.359056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdd0d28c-3f86-40a4-b91d-3b512f8c7099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.390247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cdd0d28c-3f86-40a4-b91d-3b512f8c7099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046870 Aug 29 22:53:26.390829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 829/1660] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:26.563179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-066b930a-e22a-495c-9322-8b7cf0c6ef8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:26.565634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-066b930a-e22a-495c-9322-8b7cf0c6ef8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:26.572380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-066b930a-e22a-495c-9322-8b7cf0c6ef8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.572935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-066b930a-e22a-495c-9322-8b7cf0c6ef8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.573370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-066b930a-e22a-495c-9322-8b7cf0c6ef8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.574066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-066b930a-e22a-495c-9322-8b7cf0c6ef8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.574515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-066b930a-e22a-495c-9322-8b7cf0c6ef8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.575026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-066b930a-e22a-495c-9322-8b7cf0c6ef8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.592769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:26.607293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-066b930a-e22a-495c-9322-8b7cf0c6ef8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048116 Aug 29 22:53:26.608192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 832/1661] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:26.787325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ef014e6e-e5bc-4e90-a1bc-ea6bae1aefe9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:26.789495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ef014e6e-e5bc-4e90-a1bc-ea6bae1aefe9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:26.795808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef014e6e-e5bc-4e90-a1bc-ea6bae1aefe9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.796323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef014e6e-e5bc-4e90-a1bc-ea6bae1aefe9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.796752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef014e6e-e5bc-4e90-a1bc-ea6bae1aefe9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.797434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef014e6e-e5bc-4e90-a1bc-ea6bae1aefe9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.797927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef014e6e-e5bc-4e90-a1bc-ea6bae1aefe9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.798471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef014e6e-e5bc-4e90-a1bc-ea6bae1aefe9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.828495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ef014e6e-e5bc-4e90-a1bc-ea6bae1aefe9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Aug 29 22:53:26.829908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 830/1662] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:27.269570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:27.270263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.277240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.277870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.278311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.279018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.279474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.279898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.347053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:27.355102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6439f484-8733-4fc4-9481-4ef83021a14d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090687 Aug 29 22:53:27.355679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 833/1663] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:27 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:27.403127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dd998f26-624c-4998-aec8-8174d046aece tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:27.405368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dd998f26-624c-4998-aec8-8174d046aece tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.411997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd998f26-624c-4998-aec8-8174d046aece tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.412560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd998f26-624c-4998-aec8-8174d046aece tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.412992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd998f26-624c-4998-aec8-8174d046aece tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.413692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd998f26-624c-4998-aec8-8174d046aece tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.414144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd998f26-624c-4998-aec8-8174d046aece tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.414584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd998f26-624c-4998-aec8-8174d046aece tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.447550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dd998f26-624c-4998-aec8-8174d046aece tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048354 Aug 29 22:53:27.448125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 831/1664] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:27.620509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5f0ad8cd-7440-4d6e-94b4-5da9f4f45331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:27.622741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5f0ad8cd-7440-4d6e-94b4-5da9f4f45331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.629544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f0ad8cd-7440-4d6e-94b4-5da9f4f45331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.630020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f0ad8cd-7440-4d6e-94b4-5da9f4f45331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.630450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f0ad8cd-7440-4d6e-94b4-5da9f4f45331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.631165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f0ad8cd-7440-4d6e-94b4-5da9f4f45331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.631613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f0ad8cd-7440-4d6e-94b4-5da9f4f45331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.632031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f0ad8cd-7440-4d6e-94b4-5da9f4f45331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.661833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5f0ad8cd-7440-4d6e-94b4-5da9f4f45331 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Aug 29 22:53:27.662402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 834/1665] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:27 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:27.845055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b015996-231f-4f48-bffd-78ed25fbaaf3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:27.848034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0b015996-231f-4f48-bffd-78ed25fbaaf3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.854429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b015996-231f-4f48-bffd-78ed25fbaaf3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.855233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b015996-231f-4f48-bffd-78ed25fbaaf3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.855416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b015996-231f-4f48-bffd-78ed25fbaaf3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.856163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b015996-231f-4f48-bffd-78ed25fbaaf3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.856679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b015996-231f-4f48-bffd-78ed25fbaaf3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.857183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b015996-231f-4f48-bffd-78ed25fbaaf3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.887998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0b015996-231f-4f48-bffd-78ed25fbaaf3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048807 Aug 29 22:53:27.888503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 832/1666] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:28.376783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:28.377476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:28.384004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.384522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.384960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.385738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.386194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.386628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.449720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:28.458152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef6f8400-c759-497f-9fac-f1693c68e096 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085898 Aug 29 22:53:28.458737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 835/1667] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:28 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:28.459512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-66b035d3-ebba-4451-ac18-e1285098fdc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:28.461647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-66b035d3-ebba-4451-ac18-e1285098fdc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:28.467633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66b035d3-ebba-4451-ac18-e1285098fdc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.468172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66b035d3-ebba-4451-ac18-e1285098fdc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.468610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66b035d3-ebba-4451-ac18-e1285098fdc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.469309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66b035d3-ebba-4451-ac18-e1285098fdc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.469935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66b035d3-ebba-4451-ac18-e1285098fdc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.470645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66b035d3-ebba-4451-ac18-e1285098fdc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.502893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-66b035d3-ebba-4451-ac18-e1285098fdc6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047333 Aug 29 22:53:28.503480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 833/1668] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:28.674799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0dad6e08-595c-4bc2-ad9f-f36bbd1b97fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:28.676905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0dad6e08-595c-4bc2-ad9f-f36bbd1b97fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:28.682975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dad6e08-595c-4bc2-ad9f-f36bbd1b97fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.683452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dad6e08-595c-4bc2-ad9f-f36bbd1b97fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.683885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dad6e08-595c-4bc2-ad9f-f36bbd1b97fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.684605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dad6e08-595c-4bc2-ad9f-f36bbd1b97fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.685047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dad6e08-595c-4bc2-ad9f-f36bbd1b97fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.685463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0dad6e08-595c-4bc2-ad9f-f36bbd1b97fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.715966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0dad6e08-595c-4bc2-ad9f-f36bbd1b97fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Aug 29 22:53:28.716622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 836/1669] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:28.900828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f879f895-b24e-4ca4-8b72-bc0386881f07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:28.903059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f879f895-b24e-4ca4-8b72-bc0386881f07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:28.909886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f879f895-b24e-4ca4-8b72-bc0386881f07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.910368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f879f895-b24e-4ca4-8b72-bc0386881f07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.910801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f879f895-b24e-4ca4-8b72-bc0386881f07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.911500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f879f895-b24e-4ca4-8b72-bc0386881f07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.911955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f879f895-b24e-4ca4-8b72-bc0386881f07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.912440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f879f895-b24e-4ca4-8b72-bc0386881f07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.948467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f879f895-b24e-4ca4-8b72-bc0386881f07 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Aug 29 22:53:28.948467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 834/1670] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:29.479423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:29.480039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:29.487337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.487822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.488296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.488995 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.489492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.489888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.515010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-353eee9b-21f8-4fe1-922d-f2cf5f40e874 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:29.517835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-353eee9b-21f8-4fe1-922d-f2cf5f40e874 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:29.524488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-353eee9b-21f8-4fe1-922d-f2cf5f40e874 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.524985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-353eee9b-21f8-4fe1-922d-f2cf5f40e874 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.525425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-353eee9b-21f8-4fe1-922d-f2cf5f40e874 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.526135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-353eee9b-21f8-4fe1-922d-f2cf5f40e874 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.526597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-353eee9b-21f8-4fe1-922d-f2cf5f40e874 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.527029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-353eee9b-21f8-4fe1-922d-f2cf5f40e874 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.557157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:29.560778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-353eee9b-21f8-4fe1-922d-f2cf5f40e874 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049813 Aug 29 22:53:29.561371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 835/1671] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:29.566413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eb504ea9-d9ba-45e9-9145-9558a96d7b12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090849 Aug 29 22:53:29.567152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 837/1672] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:29 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:29.728631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5bc5ae25-b792-4927-9bdd-c67e41c8ada1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:29.731048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5bc5ae25-b792-4927-9bdd-c67e41c8ada1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:29.738205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc5ae25-b792-4927-9bdd-c67e41c8ada1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.738698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc5ae25-b792-4927-9bdd-c67e41c8ada1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.739136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc5ae25-b792-4927-9bdd-c67e41c8ada1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.739853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc5ae25-b792-4927-9bdd-c67e41c8ada1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.740442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc5ae25-b792-4927-9bdd-c67e41c8ada1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.740881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bc5ae25-b792-4927-9bdd-c67e41c8ada1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.775662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5bc5ae25-b792-4927-9bdd-c67e41c8ada1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051047 Aug 29 22:53:29.776535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 836/1673] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:29.957920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-21e8cc20-4cea-486a-96b6-3f94e48e0a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:29.960159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-21e8cc20-4cea-486a-96b6-3f94e48e0a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:29.966066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21e8cc20-4cea-486a-96b6-3f94e48e0a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.966540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21e8cc20-4cea-486a-96b6-3f94e48e0a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.966978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21e8cc20-4cea-486a-96b6-3f94e48e0a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.967660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21e8cc20-4cea-486a-96b6-3f94e48e0a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.968104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21e8cc20-4cea-486a-96b6-3f94e48e0a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.968547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21e8cc20-4cea-486a-96b6-3f94e48e0a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.001664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-21e8cc20-4cea-486a-96b6-3f94e48e0a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048183 Aug 29 22:53:30.002134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 838/1674] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:30.572622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-04989ed7-a6e6-4399-be96-ad914b376291 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:30.574796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-04989ed7-a6e6-4399-be96-ad914b376291 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:30.582118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04989ed7-a6e6-4399-be96-ad914b376291 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.582600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04989ed7-a6e6-4399-be96-ad914b376291 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.583031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04989ed7-a6e6-4399-be96-ad914b376291 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.583731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04989ed7-a6e6-4399-be96-ad914b376291 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.584208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04989ed7-a6e6-4399-be96-ad914b376291 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.584635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04989ed7-a6e6-4399-be96-ad914b376291 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.586826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:30.587609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:30.593679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.594151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.594575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.595572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.596087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.596546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.611663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:30.619258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-04989ed7-a6e6-4399-be96-ad914b376291 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050625 Aug 29 22:53:30.627001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 837/1675] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:30.659483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:30.667753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c519e306-5fd6-43d9-845c-7f87455d3b38 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084692 Aug 29 22:53:30.668364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 839/1676] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:30 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:30.788892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-46643e06-ac2b-42cc-8336-10da78bc7cb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:30.791133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-46643e06-ac2b-42cc-8336-10da78bc7cb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:30.797645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46643e06-ac2b-42cc-8336-10da78bc7cb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.798810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46643e06-ac2b-42cc-8336-10da78bc7cb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.799239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46643e06-ac2b-42cc-8336-10da78bc7cb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.800017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46643e06-ac2b-42cc-8336-10da78bc7cb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.800560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46643e06-ac2b-42cc-8336-10da78bc7cb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.800981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46643e06-ac2b-42cc-8336-10da78bc7cb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.832317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-46643e06-ac2b-42cc-8336-10da78bc7cb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Aug 29 22:53:30.832803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 838/1677] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:31.014108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-20f583a0-66b3-4b60-aa55-0430c4d417c8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:31.016345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-20f583a0-66b3-4b60-aa55-0430c4d417c8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:31.023441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20f583a0-66b3-4b60-aa55-0430c4d417c8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.023926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20f583a0-66b3-4b60-aa55-0430c4d417c8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.024407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20f583a0-66b3-4b60-aa55-0430c4d417c8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.025112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20f583a0-66b3-4b60-aa55-0430c4d417c8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.025593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20f583a0-66b3-4b60-aa55-0430c4d417c8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.025998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20f583a0-66b3-4b60-aa55-0430c4d417c8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.056920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-20f583a0-66b3-4b60-aa55-0430c4d417c8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Aug 29 22:53:31.057500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 840/1678] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:31.634623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-198e7c09-b175-48bf-8a48-5362c01dbc86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:31.637232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-198e7c09-b175-48bf-8a48-5362c01dbc86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:31.644610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-198e7c09-b175-48bf-8a48-5362c01dbc86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.645086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-198e7c09-b175-48bf-8a48-5362c01dbc86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.645514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-198e7c09-b175-48bf-8a48-5362c01dbc86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.646200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-198e7c09-b175-48bf-8a48-5362c01dbc86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.646646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-198e7c09-b175-48bf-8a48-5362c01dbc86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.647064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-198e7c09-b175-48bf-8a48-5362c01dbc86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.680585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-198e7c09-b175-48bf-8a48-5362c01dbc86 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049958 Aug 29 22:53:31.681177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 839/1679] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:31.690750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:31.697096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:31.698468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.698948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.699403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.700106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.700635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.700998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.765457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:31.773314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c61e33e0-8fdb-42d9-aacb-a70af03ee633 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087180 Aug 29 22:53:31.773887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 841/1680] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:31 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:31.845290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f25c350f-63cd-4fda-82f5-90f32b81bfd2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:31.847430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f25c350f-63cd-4fda-82f5-90f32b81bfd2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:31.853414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f25c350f-63cd-4fda-82f5-90f32b81bfd2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.853895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f25c350f-63cd-4fda-82f5-90f32b81bfd2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.854333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f25c350f-63cd-4fda-82f5-90f32b81bfd2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.855022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f25c350f-63cd-4fda-82f5-90f32b81bfd2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.855474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f25c350f-63cd-4fda-82f5-90f32b81bfd2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.855898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f25c350f-63cd-4fda-82f5-90f32b81bfd2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.887043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f25c350f-63cd-4fda-82f5-90f32b81bfd2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046177 Aug 29 22:53:31.887524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 840/1681] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:32.069589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c8ff037e-c618-438d-9c42-b391ab145fa6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:32.071728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c8ff037e-c618-438d-9c42-b391ab145fa6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:32.078053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8ff037e-c618-438d-9c42-b391ab145fa6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.078528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8ff037e-c618-438d-9c42-b391ab145fa6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.079786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8ff037e-c618-438d-9c42-b391ab145fa6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.080531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8ff037e-c618-438d-9c42-b391ab145fa6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.080976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8ff037e-c618-438d-9c42-b391ab145fa6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.081401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c8ff037e-c618-438d-9c42-b391ab145fa6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.112337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c8ff037e-c618-438d-9c42-b391ab145fa6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046721 Aug 29 22:53:32.112906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 842/1682] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:32.693603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-21dd4121-76b5-4166-bfdf-12c1e2255af9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:32.695748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-21dd4121-76b5-4166-bfdf-12c1e2255af9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:32.702309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21dd4121-76b5-4166-bfdf-12c1e2255af9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.702791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21dd4121-76b5-4166-bfdf-12c1e2255af9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.703226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21dd4121-76b5-4166-bfdf-12c1e2255af9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.704781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21dd4121-76b5-4166-bfdf-12c1e2255af9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.705292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21dd4121-76b5-4166-bfdf-12c1e2255af9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.705763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-21dd4121-76b5-4166-bfdf-12c1e2255af9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.736604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-21dd4121-76b5-4166-bfdf-12c1e2255af9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046839 Aug 29 22:53:32.737038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 841/1683] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:32.794510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:32.795144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:32.802276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.802753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.803180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.803867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.804351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.804768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.867538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:32.875271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-699270b3-c825-460b-abc5-cb424f1b7473 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084688 Aug 29 22:53:32.875832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 843/1684] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:32 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:32.899107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b9f6b4d2-a2a4-4abe-834d-7c0d20f689a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:32.901908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b9f6b4d2-a2a4-4abe-834d-7c0d20f689a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:32.908539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f6b4d2-a2a4-4abe-834d-7c0d20f689a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.909027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f6b4d2-a2a4-4abe-834d-7c0d20f689a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.909461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f6b4d2-a2a4-4abe-834d-7c0d20f689a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.910166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f6b4d2-a2a4-4abe-834d-7c0d20f689a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.910618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f6b4d2-a2a4-4abe-834d-7c0d20f689a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.911041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f6b4d2-a2a4-4abe-834d-7c0d20f689a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.943500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b9f6b4d2-a2a4-4abe-834d-7c0d20f689a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048389 Aug 29 22:53:32.944168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 842/1685] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:33.125254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3ce2ea3d-8ebc-4646-a526-956a77cc6354 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:33.127757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3ce2ea3d-8ebc-4646-a526-956a77cc6354 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:33.133860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ce2ea3d-8ebc-4646-a526-956a77cc6354 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.140188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ce2ea3d-8ebc-4646-a526-956a77cc6354 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.140188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ce2ea3d-8ebc-4646-a526-956a77cc6354 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.140188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ce2ea3d-8ebc-4646-a526-956a77cc6354 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.140188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ce2ea3d-8ebc-4646-a526-956a77cc6354 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.140648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ce2ea3d-8ebc-4646-a526-956a77cc6354 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.168520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3ce2ea3d-8ebc-4646-a526-956a77cc6354 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047195 Aug 29 22:53:33.169101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 844/1686] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:33.749294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-67237e20-c4d5-40ed-ae57-c13a707abd51 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:33.751608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-67237e20-c4d5-40ed-ae57-c13a707abd51 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:33.758343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67237e20-c4d5-40ed-ae57-c13a707abd51 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.758815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67237e20-c4d5-40ed-ae57-c13a707abd51 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.759659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67237e20-c4d5-40ed-ae57-c13a707abd51 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.759918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67237e20-c4d5-40ed-ae57-c13a707abd51 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.760390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67237e20-c4d5-40ed-ae57-c13a707abd51 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.760812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-67237e20-c4d5-40ed-ae57-c13a707abd51 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.794445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-67237e20-c4d5-40ed-ae57-c13a707abd51 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049081 Aug 29 22:53:33.795029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 843/1687] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:33.897554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:33.898162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:33.904728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.905204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.905633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.906322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.906768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.907223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.956372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ca136356-bf40-448c-92ef-1860787ec5b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:33.958535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ca136356-bf40-448c-92ef-1860787ec5b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:33.964581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca136356-bf40-448c-92ef-1860787ec5b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.965066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca136356-bf40-448c-92ef-1860787ec5b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.965494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca136356-bf40-448c-92ef-1860787ec5b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.966188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca136356-bf40-448c-92ef-1860787ec5b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.966634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca136356-bf40-448c-92ef-1860787ec5b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.967053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca136356-bf40-448c-92ef-1860787ec5b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.970976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:33.979103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-68017003-f285-447a-be01-25133fd0bf44 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085526 Aug 29 22:53:33.979685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 845/1688] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:33 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:34.000824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ca136356-bf40-448c-92ef-1860787ec5b9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049257 Aug 29 22:53:34.001798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 844/1689] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:34.181684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fb7254d5-264e-4281-a1c4-bdd386eaa987 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:34.183892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fb7254d5-264e-4281-a1c4-bdd386eaa987 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:34.190645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb7254d5-264e-4281-a1c4-bdd386eaa987 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.191130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb7254d5-264e-4281-a1c4-bdd386eaa987 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.191561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb7254d5-264e-4281-a1c4-bdd386eaa987 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.192296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb7254d5-264e-4281-a1c4-bdd386eaa987 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.192752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb7254d5-264e-4281-a1c4-bdd386eaa987 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.193173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb7254d5-264e-4281-a1c4-bdd386eaa987 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.225591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fb7254d5-264e-4281-a1c4-bdd386eaa987 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047790 Aug 29 22:53:34.226165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 846/1690] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:34.806403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2c452352-dfcd-40f8-9ab5-32c935c23740 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:34.808631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2c452352-dfcd-40f8-9ab5-32c935c23740 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:34.819076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c452352-dfcd-40f8-9ab5-32c935c23740 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.819622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c452352-dfcd-40f8-9ab5-32c935c23740 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.820067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c452352-dfcd-40f8-9ab5-32c935c23740 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.820812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c452352-dfcd-40f8-9ab5-32c935c23740 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.821262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c452352-dfcd-40f8-9ab5-32c935c23740 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.821692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c452352-dfcd-40f8-9ab5-32c935c23740 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.853298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2c452352-dfcd-40f8-9ab5-32c935c23740 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050888 Aug 29 22:53:34.853862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 845/1691] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:35.000730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:35.002432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:35.008672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.009151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.009583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.010267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.010711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.011125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.012766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-32f52526-6d0e-48ee-b621-a55a13657445 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:35.014897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-32f52526-6d0e-48ee-b621-a55a13657445 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:35.022113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32f52526-6d0e-48ee-b621-a55a13657445 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.022594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32f52526-6d0e-48ee-b621-a55a13657445 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.023024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32f52526-6d0e-48ee-b621-a55a13657445 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.023722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32f52526-6d0e-48ee-b621-a55a13657445 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.024201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32f52526-6d0e-48ee-b621-a55a13657445 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.024627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32f52526-6d0e-48ee-b621-a55a13657445 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.057836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-32f52526-6d0e-48ee-b621-a55a13657445 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048768 Aug 29 22:53:35.058364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 846/1692] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:35.074435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:35.082931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d514f1be-75a7-485b-aa08-1ee76fd03ea1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086616 Aug 29 22:53:35.083502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 847/1693] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:34 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:35.238670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7368be18-9c9f-4f05-a66c-ec30ab2b5c0c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:35.240878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7368be18-9c9f-4f05-a66c-ec30ab2b5c0c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:35.246915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7368be18-9c9f-4f05-a66c-ec30ab2b5c0c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.247393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7368be18-9c9f-4f05-a66c-ec30ab2b5c0c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.247825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7368be18-9c9f-4f05-a66c-ec30ab2b5c0c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.248699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7368be18-9c9f-4f05-a66c-ec30ab2b5c0c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.249156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7368be18-9c9f-4f05-a66c-ec30ab2b5c0c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.249570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7368be18-9c9f-4f05-a66c-ec30ab2b5c0c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.280075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7368be18-9c9f-4f05-a66c-ec30ab2b5c0c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045800 Aug 29 22:53:35.280669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 847/1694] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:35.866549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5bdb138b-bac3-4269-a73f-9ffd903cad13 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:35.868755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5bdb138b-bac3-4269-a73f-9ffd903cad13 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:35.874808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5bdb138b-bac3-4269-a73f-9ffd903cad13 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.875278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5bdb138b-bac3-4269-a73f-9ffd903cad13 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.875705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5bdb138b-bac3-4269-a73f-9ffd903cad13 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.877437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5bdb138b-bac3-4269-a73f-9ffd903cad13 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.878065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5bdb138b-bac3-4269-a73f-9ffd903cad13 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.878489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5bdb138b-bac3-4269-a73f-9ffd903cad13 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.909403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5bdb138b-bac3-4269-a73f-9ffd903cad13 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046821 Aug 29 22:53:35.909981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 848/1695] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:36.070427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c97b12b8-8144-458b-9721-277464bbe205 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:36.072620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c97b12b8-8144-458b-9721-277464bbe205 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:36.079803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c97b12b8-8144-458b-9721-277464bbe205 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.080025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c97b12b8-8144-458b-9721-277464bbe205 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.080568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c97b12b8-8144-458b-9721-277464bbe205 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.081131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c97b12b8-8144-458b-9721-277464bbe205 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.081592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c97b12b8-8144-458b-9721-277464bbe205 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.082017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c97b12b8-8144-458b-9721-277464bbe205 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.103965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:36.104568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:36.111482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.112128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.112591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.113295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.113751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.114169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.114394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c97b12b8-8144-458b-9721-277464bbe205 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047977 Aug 29 22:53:36.114985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 848/1696] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:36.118495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:36.181165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:36.190065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c38dd06b-1aa5-458e-98ca-8e92a423fe0e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089974 Aug 29 22:53:36.190653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 849/1697] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:36 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:36.292491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4c9b3539-74d1-4d01-b78b-15fac02a5d0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:36.294645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4c9b3539-74d1-4d01-b78b-15fac02a5d0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:36.300691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c9b3539-74d1-4d01-b78b-15fac02a5d0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.301171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c9b3539-74d1-4d01-b78b-15fac02a5d0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.301602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c9b3539-74d1-4d01-b78b-15fac02a5d0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.302298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c9b3539-74d1-4d01-b78b-15fac02a5d0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.302749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c9b3539-74d1-4d01-b78b-15fac02a5d0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.303173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c9b3539-74d1-4d01-b78b-15fac02a5d0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.335495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4c9b3539-74d1-4d01-b78b-15fac02a5d0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046937 Aug 29 22:53:36.336084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 849/1698] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:36.921942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-674fcd2c-70e1-41c5-9ed0-321c1520bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:36.924784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-674fcd2c-70e1-41c5-9ed0-321c1520bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:36.931095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-674fcd2c-70e1-41c5-9ed0-321c1520bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.931576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-674fcd2c-70e1-41c5-9ed0-321c1520bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.932010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-674fcd2c-70e1-41c5-9ed0-321c1520bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.932738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-674fcd2c-70e1-41c5-9ed0-321c1520bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.933190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-674fcd2c-70e1-41c5-9ed0-321c1520bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.933614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-674fcd2c-70e1-41c5-9ed0-321c1520bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.964359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-674fcd2c-70e1-41c5-9ed0-321c1520bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046365 Aug 29 22:53:36.964924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 850/1699] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:37.126319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-96019e6f-5953-4544-8736-a7c9c25bfefd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:37.128641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-96019e6f-5953-4544-8736-a7c9c25bfefd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:37.135205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96019e6f-5953-4544-8736-a7c9c25bfefd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.135702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96019e6f-5953-4544-8736-a7c9c25bfefd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.136494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96019e6f-5953-4544-8736-a7c9c25bfefd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.136942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96019e6f-5953-4544-8736-a7c9c25bfefd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.137435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96019e6f-5953-4544-8736-a7c9c25bfefd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.137869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96019e6f-5953-4544-8736-a7c9c25bfefd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.171031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-96019e6f-5953-4544-8736-a7c9c25bfefd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048602 Aug 29 22:53:37.171513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 850/1700] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:37.211325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:37.211943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:37.218623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.219110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.219583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.221088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.221612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.222046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.284908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:37.292913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-db290f84-00ab-483c-84a7-641678f2cd1e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085535 Aug 29 22:53:37.293490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 851/1701] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:37 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:37.348806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-868bb326-dd30-4ee5-b064-ee93b7509fcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:37.350938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-868bb326-dd30-4ee5-b064-ee93b7509fcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:37.356830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-868bb326-dd30-4ee5-b064-ee93b7509fcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.357302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-868bb326-dd30-4ee5-b064-ee93b7509fcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.357772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-868bb326-dd30-4ee5-b064-ee93b7509fcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.358454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-868bb326-dd30-4ee5-b064-ee93b7509fcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.358903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-868bb326-dd30-4ee5-b064-ee93b7509fcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.359323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-868bb326-dd30-4ee5-b064-ee93b7509fcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.389855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-868bb326-dd30-4ee5-b064-ee93b7509fcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045901 Aug 29 22:53:37.399546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 851/1702] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:37.976990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f6c4ca06-1800-447a-8006-ac0ad6e2ae81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:37.979191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f6c4ca06-1800-447a-8006-ac0ad6e2ae81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:37.985744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6c4ca06-1800-447a-8006-ac0ad6e2ae81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.986513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6c4ca06-1800-447a-8006-ac0ad6e2ae81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.987019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6c4ca06-1800-447a-8006-ac0ad6e2ae81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.987715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6c4ca06-1800-447a-8006-ac0ad6e2ae81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.988188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6c4ca06-1800-447a-8006-ac0ad6e2ae81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.988622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6c4ca06-1800-447a-8006-ac0ad6e2ae81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.019780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f6c4ca06-1800-447a-8006-ac0ad6e2ae81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046829 Aug 29 22:53:38.020370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 852/1703] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:38.184383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5abf4fe3-cf81-4474-b6dd-d3a8bcf16d15 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:38.186544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5abf4fe3-cf81-4474-b6dd-d3a8bcf16d15 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:38.194234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5abf4fe3-cf81-4474-b6dd-d3a8bcf16d15 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.194717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5abf4fe3-cf81-4474-b6dd-d3a8bcf16d15 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.195157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5abf4fe3-cf81-4474-b6dd-d3a8bcf16d15 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.195856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5abf4fe3-cf81-4474-b6dd-d3a8bcf16d15 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.196340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5abf4fe3-cf81-4474-b6dd-d3a8bcf16d15 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.196769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5abf4fe3-cf81-4474-b6dd-d3a8bcf16d15 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.228711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5abf4fe3-cf81-4474-b6dd-d3a8bcf16d15 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048450 Aug 29 22:53:38.229286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 852/1704] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:38.314511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:38.315289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:38.321788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.322266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.322697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.323384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.323832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.324288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.387465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:38.396824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0a6f968e-51ef-43d7-b93b-c057b650e2d4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086852 Aug 29 22:53:38.398184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 853/1705] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:38 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:38.403471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-608a50b1-40ac-46dd-ad11-1c9ed59d8b70 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:38.405696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-608a50b1-40ac-46dd-ad11-1c9ed59d8b70 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:38.412221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608a50b1-40ac-46dd-ad11-1c9ed59d8b70 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.412710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608a50b1-40ac-46dd-ad11-1c9ed59d8b70 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.413144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608a50b1-40ac-46dd-ad11-1c9ed59d8b70 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.413848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608a50b1-40ac-46dd-ad11-1c9ed59d8b70 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.414362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608a50b1-40ac-46dd-ad11-1c9ed59d8b70 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.414744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-608a50b1-40ac-46dd-ad11-1c9ed59d8b70 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.446493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-608a50b1-40ac-46dd-ad11-1c9ed59d8b70 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046857 Aug 29 22:53:38.446970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 853/1706] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:39.032961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8f1c30f9-e84d-430f-92c2-984438f8924f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:39.035159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8f1c30f9-e84d-430f-92c2-984438f8924f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:39.041377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f1c30f9-e84d-430f-92c2-984438f8924f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.041860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f1c30f9-e84d-430f-92c2-984438f8924f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.042294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f1c30f9-e84d-430f-92c2-984438f8924f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.042994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f1c30f9-e84d-430f-92c2-984438f8924f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.043442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f1c30f9-e84d-430f-92c2-984438f8924f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.043863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f1c30f9-e84d-430f-92c2-984438f8924f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.076561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8f1c30f9-e84d-430f-92c2-984438f8924f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048138 Aug 29 22:53:39.077120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 854/1707] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:39.242155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-120a6ec8-9b8d-48f0-8aa3-6db7b09844ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:39.244427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-120a6ec8-9b8d-48f0-8aa3-6db7b09844ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:39.251060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a6ec8-9b8d-48f0-8aa3-6db7b09844ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.251659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a6ec8-9b8d-48f0-8aa3-6db7b09844ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.252106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a6ec8-9b8d-48f0-8aa3-6db7b09844ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.252831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a6ec8-9b8d-48f0-8aa3-6db7b09844ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.253328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a6ec8-9b8d-48f0-8aa3-6db7b09844ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.253756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a6ec8-9b8d-48f0-8aa3-6db7b09844ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.268012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:39.285146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-120a6ec8-9b8d-48f0-8aa3-6db7b09844ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047116 Aug 29 22:53:39.285722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 854/1708] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:39.418976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:39.419625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:39.427502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.427992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.428463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.429156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.429598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.430014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.460122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-25a5f376-35f5-4984-84a7-8f9dafca6f02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:39.462331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-25a5f376-35f5-4984-84a7-8f9dafca6f02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:39.469851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25a5f376-35f5-4984-84a7-8f9dafca6f02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.470638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25a5f376-35f5-4984-84a7-8f9dafca6f02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.471045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25a5f376-35f5-4984-84a7-8f9dafca6f02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.472821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25a5f376-35f5-4984-84a7-8f9dafca6f02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.472821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25a5f376-35f5-4984-84a7-8f9dafca6f02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.472821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25a5f376-35f5-4984-84a7-8f9dafca6f02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.495469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:39.504522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2f680bc0-dba4-4562-9564-1f60efdbe540 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089416 Aug 29 22:53:39.505395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-25a5f376-35f5-4984-84a7-8f9dafca6f02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049101 Aug 29 22:53:39.505529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 855/1709] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:39 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:39.505788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 855/1710] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:40.089872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d28fe665-14d0-4fc2-934c-58ed58809939 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:40.091989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d28fe665-14d0-4fc2-934c-58ed58809939 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:40.098651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d28fe665-14d0-4fc2-934c-58ed58809939 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.099140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d28fe665-14d0-4fc2-934c-58ed58809939 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.099587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d28fe665-14d0-4fc2-934c-58ed58809939 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.100330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d28fe665-14d0-4fc2-934c-58ed58809939 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.100832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d28fe665-14d0-4fc2-934c-58ed58809939 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.101264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d28fe665-14d0-4fc2-934c-58ed58809939 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.134177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d28fe665-14d0-4fc2-934c-58ed58809939 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048600 Aug 29 22:53:40.134767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 856/1711] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:40.298161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-91108641-6a39-4e1a-9441-c390c15b0adc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:40.300520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-91108641-6a39-4e1a-9441-c390c15b0adc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:40.307526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91108641-6a39-4e1a-9441-c390c15b0adc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.308019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91108641-6a39-4e1a-9441-c390c15b0adc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.308472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91108641-6a39-4e1a-9441-c390c15b0adc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.309174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91108641-6a39-4e1a-9441-c390c15b0adc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.309628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91108641-6a39-4e1a-9441-c390c15b0adc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.310058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91108641-6a39-4e1a-9441-c390c15b0adc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.342626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-91108641-6a39-4e1a-9441-c390c15b0adc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048879 Aug 29 22:53:40.343107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 856/1712] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:40 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:40.517498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-948bda57-bc6a-4c14-8beb-63be2db27cf0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:40.519764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-948bda57-bc6a-4c14-8beb-63be2db27cf0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:40.525969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:40.526404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-948bda57-bc6a-4c14-8beb-63be2db27cf0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.526575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:40.526887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-948bda57-bc6a-4c14-8beb-63be2db27cf0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.527322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-948bda57-bc6a-4c14-8beb-63be2db27cf0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.528013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-948bda57-bc6a-4c14-8beb-63be2db27cf0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.528488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-948bda57-bc6a-4c14-8beb-63be2db27cf0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.528919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-948bda57-bc6a-4c14-8beb-63be2db27cf0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.533379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.533958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.534394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.535095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.535546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.535963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.560641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-948bda57-bc6a-4c14-8beb-63be2db27cf0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047607 Aug 29 22:53:40.561431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 857/1713] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:40.600558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:40.608501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3ace66fe-0c0e-480f-a21a-e78c073be1c0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086265 Aug 29 22:53:40.609070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 857/1714] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:40 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:41.147242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b6b87d09-c201-43cc-b7de-564ce3308199 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:41.149456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b6b87d09-c201-43cc-b7de-564ce3308199 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:41.155934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6b87d09-c201-43cc-b7de-564ce3308199 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.156449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6b87d09-c201-43cc-b7de-564ce3308199 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.156914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6b87d09-c201-43cc-b7de-564ce3308199 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.157934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6b87d09-c201-43cc-b7de-564ce3308199 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.158421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6b87d09-c201-43cc-b7de-564ce3308199 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.158841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6b87d09-c201-43cc-b7de-564ce3308199 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.191131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b6b87d09-c201-43cc-b7de-564ce3308199 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047760 Aug 29 22:53:41.191618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 858/1715] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:41.355580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0d37b021-8c85-47ad-bbac-45a7f57dd9ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:41.357840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0d37b021-8c85-47ad-bbac-45a7f57dd9ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:41.365556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d37b021-8c85-47ad-bbac-45a7f57dd9ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.366037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d37b021-8c85-47ad-bbac-45a7f57dd9ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.366467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d37b021-8c85-47ad-bbac-45a7f57dd9ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.367165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d37b021-8c85-47ad-bbac-45a7f57dd9ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.367620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d37b021-8c85-47ad-bbac-45a7f57dd9ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.368045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d37b021-8c85-47ad-bbac-45a7f57dd9ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.400266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0d37b021-8c85-47ad-bbac-45a7f57dd9ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048573 Aug 29 22:53:41.400853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 858/1716] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:41.573874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5fffdf3c-0bb6-4694-90b2-5dd0cb1991b7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:41.575971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5fffdf3c-0bb6-4694-90b2-5dd0cb1991b7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:41.583040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fffdf3c-0bb6-4694-90b2-5dd0cb1991b7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.583545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fffdf3c-0bb6-4694-90b2-5dd0cb1991b7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.583970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fffdf3c-0bb6-4694-90b2-5dd0cb1991b7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.584702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fffdf3c-0bb6-4694-90b2-5dd0cb1991b7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.585147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fffdf3c-0bb6-4694-90b2-5dd0cb1991b7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.585563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fffdf3c-0bb6-4694-90b2-5dd0cb1991b7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.618561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5fffdf3c-0bb6-4694-90b2-5dd0cb1991b7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048850 Aug 29 22:53:41.619133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 859/1717] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:41.629063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:41.629694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:41.636005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.636534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.636972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.637674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.638130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.638564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.708093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:41.716510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7b66e932-c35f-4d8a-a3e1-7d010fe71c1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091212 Aug 29 22:53:41.717104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 859/1718] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:41 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:42.204730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d63fb728-462a-4399-bdc3-9208342ddd5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:42.206921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d63fb728-462a-4399-bdc3-9208342ddd5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:42.215329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d63fb728-462a-4399-bdc3-9208342ddd5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.215919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d63fb728-462a-4399-bdc3-9208342ddd5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.216387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d63fb728-462a-4399-bdc3-9208342ddd5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.217083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d63fb728-462a-4399-bdc3-9208342ddd5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.217528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d63fb728-462a-4399-bdc3-9208342ddd5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.217941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d63fb728-462a-4399-bdc3-9208342ddd5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.248425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d63fb728-462a-4399-bdc3-9208342ddd5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048468 Aug 29 22:53:42.249002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 860/1719] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:42.412737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2c639d2d-4ace-47ac-82ab-c5f1bbd9cafc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:42.414939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2c639d2d-4ace-47ac-82ab-c5f1bbd9cafc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:42.421520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c639d2d-4ace-47ac-82ab-c5f1bbd9cafc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.422006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c639d2d-4ace-47ac-82ab-c5f1bbd9cafc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.422444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c639d2d-4ace-47ac-82ab-c5f1bbd9cafc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.423833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c639d2d-4ace-47ac-82ab-c5f1bbd9cafc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.424334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c639d2d-4ace-47ac-82ab-c5f1bbd9cafc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.424765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c639d2d-4ace-47ac-82ab-c5f1bbd9cafc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.456394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2c639d2d-4ace-47ac-82ab-c5f1bbd9cafc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047634 Aug 29 22:53:42.456889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 860/1720] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:42.632040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6401bada-7394-49f8-a9f0-1c51b668c9b2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:42.634245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6401bada-7394-49f8-a9f0-1c51b668c9b2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:42.641016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6401bada-7394-49f8-a9f0-1c51b668c9b2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.641393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6401bada-7394-49f8-a9f0-1c51b668c9b2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.641825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6401bada-7394-49f8-a9f0-1c51b668c9b2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.642526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6401bada-7394-49f8-a9f0-1c51b668c9b2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.643042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6401bada-7394-49f8-a9f0-1c51b668c9b2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.643396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6401bada-7394-49f8-a9f0-1c51b668c9b2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.674334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6401bada-7394-49f8-a9f0-1c51b668c9b2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Aug 29 22:53:42.674906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 861/1721] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:42.738784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:42.739300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:42.745355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.745835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.746268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.746964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.747455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.747895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.810914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:42.819501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c36a173e-9e58-4534-baf8-11b6d8f745e5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085267 Aug 29 22:53:42.820436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 861/1722] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:42 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:43.261665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a23893ff-b6c2-4e57-8e73-1c06f017017a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:43.263803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a23893ff-b6c2-4e57-8e73-1c06f017017a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:43.270499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a23893ff-b6c2-4e57-8e73-1c06f017017a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.270970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a23893ff-b6c2-4e57-8e73-1c06f017017a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.271448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a23893ff-b6c2-4e57-8e73-1c06f017017a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.272091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a23893ff-b6c2-4e57-8e73-1c06f017017a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.272573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a23893ff-b6c2-4e57-8e73-1c06f017017a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.272992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a23893ff-b6c2-4e57-8e73-1c06f017017a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.303834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a23893ff-b6c2-4e57-8e73-1c06f017017a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046108 Aug 29 22:53:43.304440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 862/1723] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:43.468710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-10887ccf-6d3d-407c-ba3e-ab5f08eaebcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:43.471520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-10887ccf-6d3d-407c-ba3e-ab5f08eaebcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:43.478298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10887ccf-6d3d-407c-ba3e-ab5f08eaebcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.478769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10887ccf-6d3d-407c-ba3e-ab5f08eaebcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.479201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10887ccf-6d3d-407c-ba3e-ab5f08eaebcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.479933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10887ccf-6d3d-407c-ba3e-ab5f08eaebcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.480424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10887ccf-6d3d-407c-ba3e-ab5f08eaebcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.480837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10887ccf-6d3d-407c-ba3e-ab5f08eaebcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.513201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-10887ccf-6d3d-407c-ba3e-ab5f08eaebcf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048342 Aug 29 22:53:43.513670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 862/1724] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:43.687250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6fdbfcbf-8a64-46c1-9821-8a164262ea01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:43.689889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6fdbfcbf-8a64-46c1-9821-8a164262ea01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:43.696262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fdbfcbf-8a64-46c1-9821-8a164262ea01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.696746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fdbfcbf-8a64-46c1-9821-8a164262ea01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.697182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fdbfcbf-8a64-46c1-9821-8a164262ea01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.697881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fdbfcbf-8a64-46c1-9821-8a164262ea01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.698335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fdbfcbf-8a64-46c1-9821-8a164262ea01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.698758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fdbfcbf-8a64-46c1-9821-8a164262ea01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.731291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6fdbfcbf-8a64-46c1-9821-8a164262ea01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047978 Aug 29 22:53:43.731881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 863/1725] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:43.841279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:43.841901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:43.851043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.851535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.851971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.852712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.853165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.853873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.919601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:43.928676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1ca86016-0797-44a9-ae68-a6239b1509a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091411 Aug 29 22:53:43.929254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 863/1726] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:43 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:44.317222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8a647b19-cee7-45de-a47d-bb7e7caad8ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:44.319404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8a647b19-cee7-45de-a47d-bb7e7caad8ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:44.325549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a647b19-cee7-45de-a47d-bb7e7caad8ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.326008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a647b19-cee7-45de-a47d-bb7e7caad8ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.326439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a647b19-cee7-45de-a47d-bb7e7caad8ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.327136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a647b19-cee7-45de-a47d-bb7e7caad8ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.327610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a647b19-cee7-45de-a47d-bb7e7caad8ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.328010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a647b19-cee7-45de-a47d-bb7e7caad8ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.359124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8a647b19-cee7-45de-a47d-bb7e7caad8ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046856 Aug 29 22:53:44.359697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 864/1727] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:44.526158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-14dc792a-a49d-4873-bfb3-5f6c71bea560 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:44.528363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-14dc792a-a49d-4873-bfb3-5f6c71bea560 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:44.535280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14dc792a-a49d-4873-bfb3-5f6c71bea560 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.535895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14dc792a-a49d-4873-bfb3-5f6c71bea560 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.536370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14dc792a-a49d-4873-bfb3-5f6c71bea560 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.537073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14dc792a-a49d-4873-bfb3-5f6c71bea560 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.537525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14dc792a-a49d-4873-bfb3-5f6c71bea560 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.537950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14dc792a-a49d-4873-bfb3-5f6c71bea560 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.569960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-14dc792a-a49d-4873-bfb3-5f6c71bea560 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047825 Aug 29 22:53:44.570454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 864/1728] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:44.747368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cb12cda2-5b89-4926-8e2f-2c6a0a66aee1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:44.749566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cb12cda2-5b89-4926-8e2f-2c6a0a66aee1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:44.752747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:44.763519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb12cda2-5b89-4926-8e2f-2c6a0a66aee1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.764001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb12cda2-5b89-4926-8e2f-2c6a0a66aee1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.764480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb12cda2-5b89-4926-8e2f-2c6a0a66aee1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.765378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb12cda2-5b89-4926-8e2f-2c6a0a66aee1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.765848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb12cda2-5b89-4926-8e2f-2c6a0a66aee1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.767198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cb12cda2-5b89-4926-8e2f-2c6a0a66aee1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.794197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:44.801156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cb12cda2-5b89-4926-8e2f-2c6a0a66aee1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057729 Aug 29 22:53:44.801802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 865/1729] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:44.950000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:44.951929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:44.957621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.958106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.958543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.959268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.959719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.960163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.032819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:45.033358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9715b891-c368-436d-9c0f-8bc3a450529d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086870 Aug 29 22:53:45.034035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 865/1730] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:44 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:45.373067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2a51b955-4c30-435b-951e-b4aca97714a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:45.375261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2a51b955-4c30-435b-951e-b4aca97714a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:45.381861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a51b955-4c30-435b-951e-b4aca97714a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.382343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a51b955-4c30-435b-951e-b4aca97714a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.382806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a51b955-4c30-435b-951e-b4aca97714a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.383467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a51b955-4c30-435b-951e-b4aca97714a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.383919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a51b955-4c30-435b-951e-b4aca97714a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.384364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a51b955-4c30-435b-951e-b4aca97714a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.416222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2a51b955-4c30-435b-951e-b4aca97714a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047673 Aug 29 22:53:45.416866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 866/1731] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:45.583208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-24a157cd-0832-4a1f-89a2-300fb9274a42 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:45.585455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-24a157cd-0832-4a1f-89a2-300fb9274a42 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:45.592023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a157cd-0832-4a1f-89a2-300fb9274a42 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.592538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a157cd-0832-4a1f-89a2-300fb9274a42 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.592977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a157cd-0832-4a1f-89a2-300fb9274a42 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.593719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a157cd-0832-4a1f-89a2-300fb9274a42 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.594171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a157cd-0832-4a1f-89a2-300fb9274a42 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.594673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-24a157cd-0832-4a1f-89a2-300fb9274a42 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.628531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-24a157cd-0832-4a1f-89a2-300fb9274a42 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049681 Aug 29 22:53:45.629119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 866/1732] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:45.814381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5d1ecc55-b4d0-4e26-a927-46a06116e774 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:45.816670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5d1ecc55-b4d0-4e26-a927-46a06116e774 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:45.823189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1ecc55-b4d0-4e26-a927-46a06116e774 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.824295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1ecc55-b4d0-4e26-a927-46a06116e774 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.824295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1ecc55-b4d0-4e26-a927-46a06116e774 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.824822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1ecc55-b4d0-4e26-a927-46a06116e774 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.825273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1ecc55-b4d0-4e26-a927-46a06116e774 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.825695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5d1ecc55-b4d0-4e26-a927-46a06116e774 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.858133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5d1ecc55-b4d0-4e26-a927-46a06116e774 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048270 Aug 29 22:53:45.858710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 867/1733] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:46.054707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:46.055364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:46.061412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.061899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.062344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.063555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.064286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.064863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.130770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:46.138672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d86ad68e-63ee-4f71-ac7b-ec064f577fed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087851 Aug 29 22:53:46.139243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 867/1734] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:46 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:46.429881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aab3904c-397a-4bac-b2be-f1b8d012c792 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:46.432181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aab3904c-397a-4bac-b2be-f1b8d012c792 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:46.439118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aab3904c-397a-4bac-b2be-f1b8d012c792 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.439612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aab3904c-397a-4bac-b2be-f1b8d012c792 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.440055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aab3904c-397a-4bac-b2be-f1b8d012c792 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.440796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aab3904c-397a-4bac-b2be-f1b8d012c792 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.441252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aab3904c-397a-4bac-b2be-f1b8d012c792 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.441678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aab3904c-397a-4bac-b2be-f1b8d012c792 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.473069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aab3904c-397a-4bac-b2be-f1b8d012c792 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047251 Aug 29 22:53:46.473692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 868/1735] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:46.641275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1ce6be36-4c04-4954-9b38-fbf890fcdec3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:46.643862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1ce6be36-4c04-4954-9b38-fbf890fcdec3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:46.650909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce6be36-4c04-4954-9b38-fbf890fcdec3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.651047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce6be36-4c04-4954-9b38-fbf890fcdec3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.651404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce6be36-4c04-4954-9b38-fbf890fcdec3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.652106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce6be36-4c04-4954-9b38-fbf890fcdec3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.652582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce6be36-4c04-4954-9b38-fbf890fcdec3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.653005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ce6be36-4c04-4954-9b38-fbf890fcdec3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.687140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1ce6be36-4c04-4954-9b38-fbf890fcdec3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049761 Aug 29 22:53:46.687639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 868/1736] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:46.871365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6b790a4e-717d-4688-862d-ad7c60c29773 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:46.873899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6b790a4e-717d-4688-862d-ad7c60c29773 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:46.880977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b790a4e-717d-4688-862d-ad7c60c29773 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.881467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b790a4e-717d-4688-862d-ad7c60c29773 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.881904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b790a4e-717d-4688-862d-ad7c60c29773 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.882609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b790a4e-717d-4688-862d-ad7c60c29773 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.883063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b790a4e-717d-4688-862d-ad7c60c29773 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.883487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6b790a4e-717d-4688-862d-ad7c60c29773 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.916484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6b790a4e-717d-4688-862d-ad7c60c29773 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049544 Aug 29 22:53:46.917079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 869/1737] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:46 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:47.161291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:47.161911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:47.168779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.169173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.169610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.170315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.170771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.171195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.239151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:47.247545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5ca806df-a5f1-4452-9c60-dccbb00cd991 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090703 Aug 29 22:53:47.248125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 869/1738] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:47 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:47.487899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-188c5904-0fd7-426e-92b1-8f68e70926b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:47.490169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-188c5904-0fd7-426e-92b1-8f68e70926b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:47.496839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-188c5904-0fd7-426e-92b1-8f68e70926b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.500617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-188c5904-0fd7-426e-92b1-8f68e70926b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.500617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-188c5904-0fd7-426e-92b1-8f68e70926b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.500617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-188c5904-0fd7-426e-92b1-8f68e70926b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.500617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-188c5904-0fd7-426e-92b1-8f68e70926b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.501263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-188c5904-0fd7-426e-92b1-8f68e70926b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.536736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-188c5904-0fd7-426e-92b1-8f68e70926b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054192 Aug 29 22:53:47.537336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 870/1739] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:47.699139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8fb7c80e-855e-4ad2-8bb7-56a0553f5d24 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:47.701548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8fb7c80e-855e-4ad2-8bb7-56a0553f5d24 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:47.709215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fb7c80e-855e-4ad2-8bb7-56a0553f5d24 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.709704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fb7c80e-855e-4ad2-8bb7-56a0553f5d24 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.710162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fb7c80e-855e-4ad2-8bb7-56a0553f5d24 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.710876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fb7c80e-855e-4ad2-8bb7-56a0553f5d24 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.711335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fb7c80e-855e-4ad2-8bb7-56a0553f5d24 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.711758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fb7c80e-855e-4ad2-8bb7-56a0553f5d24 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.743230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8fb7c80e-855e-4ad2-8bb7-56a0553f5d24 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047965 Aug 29 22:53:47.743727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 870/1740] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:47.930199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fbf7a622-4e54-4dd9-bfe1-12c0bb8e69f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:47.932452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fbf7a622-4e54-4dd9-bfe1-12c0bb8e69f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:47.939841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbf7a622-4e54-4dd9-bfe1-12c0bb8e69f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.940361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbf7a622-4e54-4dd9-bfe1-12c0bb8e69f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.940788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbf7a622-4e54-4dd9-bfe1-12c0bb8e69f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.941484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbf7a622-4e54-4dd9-bfe1-12c0bb8e69f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.941926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbf7a622-4e54-4dd9-bfe1-12c0bb8e69f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.942342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbf7a622-4e54-4dd9-bfe1-12c0bb8e69f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.974435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fbf7a622-4e54-4dd9-bfe1-12c0bb8e69f0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048349 Aug 29 22:53:47.975012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 871/1741] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:48.269972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:48.270708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:48.277033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.277411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.277851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.278550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.279012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.279436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.282161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:48.344081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:48.352052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a94312cd-9255-4e4a-982e-4a7c6d91c098 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086739 Aug 29 22:53:48.352658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 871/1742] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:48 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:48.550055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b4e9aed5-b985-4fdf-98f8-a6991df3c400 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:48.552109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b4e9aed5-b985-4fdf-98f8-a6991df3c400 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:48.558684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4e9aed5-b985-4fdf-98f8-a6991df3c400 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.559162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4e9aed5-b985-4fdf-98f8-a6991df3c400 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.559591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4e9aed5-b985-4fdf-98f8-a6991df3c400 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.560353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4e9aed5-b985-4fdf-98f8-a6991df3c400 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.560814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4e9aed5-b985-4fdf-98f8-a6991df3c400 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.561219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4e9aed5-b985-4fdf-98f8-a6991df3c400 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.592969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b4e9aed5-b985-4fdf-98f8-a6991df3c400 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047470 Aug 29 22:53:48.593526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 872/1743] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:48.757450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cdbbcc9a-4b31-4d90-8c31-3d8a6bc443cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:48.760801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cdbbcc9a-4b31-4d90-8c31-3d8a6bc443cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:48.763939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:48.769366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdbbcc9a-4b31-4d90-8c31-3d8a6bc443cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.769853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdbbcc9a-4b31-4d90-8c31-3d8a6bc443cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.770293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdbbcc9a-4b31-4d90-8c31-3d8a6bc443cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.770999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdbbcc9a-4b31-4d90-8c31-3d8a6bc443cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.771545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdbbcc9a-4b31-4d90-8c31-3d8a6bc443cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.771972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdbbcc9a-4b31-4d90-8c31-3d8a6bc443cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.806018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cdbbcc9a-4b31-4d90-8c31-3d8a6bc443cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054040 Aug 29 22:53:48.806519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 872/1744] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:48.987015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3ac1c4ed-92a0-4211-81a3-628841a6d5f5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:48.989218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3ac1c4ed-92a0-4211-81a3-628841a6d5f5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:48.995736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4ed-92a0-4211-81a3-628841a6d5f5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.001122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4ed-92a0-4211-81a3-628841a6d5f5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.001122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4ed-92a0-4211-81a3-628841a6d5f5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.001122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4ed-92a0-4211-81a3-628841a6d5f5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.001122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4ed-92a0-4211-81a3-628841a6d5f5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.001550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4ed-92a0-4211-81a3-628841a6d5f5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.028392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3ac1c4ed-92a0-4211-81a3-628841a6d5f5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046092 Aug 29 22:53:49.028967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 873/1745] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:49.372873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:49.373505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:49.379660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.380159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.380604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.381425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.381883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.382305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.538081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:49.546141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c11f0660-7853-437d-99c3-458402b34535 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.177155 Aug 29 22:53:49.546708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 873/1746] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:49 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:49.605916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-80cafd49-ab23-404a-9910-a34dd2491964 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:49.608054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-80cafd49-ab23-404a-9910-a34dd2491964 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:49.614645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80cafd49-ab23-404a-9910-a34dd2491964 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.615191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80cafd49-ab23-404a-9910-a34dd2491964 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.615628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80cafd49-ab23-404a-9910-a34dd2491964 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.616396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80cafd49-ab23-404a-9910-a34dd2491964 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.616850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80cafd49-ab23-404a-9910-a34dd2491964 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.617274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80cafd49-ab23-404a-9910-a34dd2491964 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.649018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-80cafd49-ab23-404a-9910-a34dd2491964 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047026 Aug 29 22:53:49.649508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 874/1747] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:49.818458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1bf39f8c-eecb-40ff-8dd8-12d34f7762e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:49.820676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1bf39f8c-eecb-40ff-8dd8-12d34f7762e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:49.827193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bf39f8c-eecb-40ff-8dd8-12d34f7762e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.827680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bf39f8c-eecb-40ff-8dd8-12d34f7762e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.828731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bf39f8c-eecb-40ff-8dd8-12d34f7762e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.829147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bf39f8c-eecb-40ff-8dd8-12d34f7762e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.829610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bf39f8c-eecb-40ff-8dd8-12d34f7762e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.830038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1bf39f8c-eecb-40ff-8dd8-12d34f7762e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.864114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1bf39f8c-eecb-40ff-8dd8-12d34f7762e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049642 Aug 29 22:53:49.864734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 874/1748] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:50.041635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-787a481b-b727-4a16-9504-d9d8e1bcd8ff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:50.044050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-787a481b-b727-4a16-9504-d9d8e1bcd8ff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:50.050812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-787a481b-b727-4a16-9504-d9d8e1bcd8ff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.051307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-787a481b-b727-4a16-9504-d9d8e1bcd8ff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.051747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-787a481b-b727-4a16-9504-d9d8e1bcd8ff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.052476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-787a481b-b727-4a16-9504-d9d8e1bcd8ff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.052936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-787a481b-b727-4a16-9504-d9d8e1bcd8ff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.053361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-787a481b-b727-4a16-9504-d9d8e1bcd8ff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.085054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-787a481b-b727-4a16-9504-d9d8e1bcd8ff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047400 Aug 29 22:53:50.085635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 875/1749] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:50.567453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:50.568058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:50.574235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.574735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.575169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.575870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.576368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.576797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.643470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:50.651250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-81dd6abb-b050-4878-b2e1-b0530400174c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088205 Aug 29 22:53:50.651829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 875/1750] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:50 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:50.661823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a4a4e6af-08e4-4a30-a6ec-4d76308d59a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:50.664369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a4a4e6af-08e4-4a30-a6ec-4d76308d59a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:50.670867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4a4e6af-08e4-4a30-a6ec-4d76308d59a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.671353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4a4e6af-08e4-4a30-a6ec-4d76308d59a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.671789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4a4e6af-08e4-4a30-a6ec-4d76308d59a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.673259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4a4e6af-08e4-4a30-a6ec-4d76308d59a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.673719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4a4e6af-08e4-4a30-a6ec-4d76308d59a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.674145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4a4e6af-08e4-4a30-a6ec-4d76308d59a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.711376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a4a4e6af-08e4-4a30-a6ec-4d76308d59a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053700 Aug 29 22:53:50.711959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 876/1751] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:50.877339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-06da12d1-7c6f-462e-975f-ef7762995a23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:50.879534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-06da12d1-7c6f-462e-975f-ef7762995a23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:50.886280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06da12d1-7c6f-462e-975f-ef7762995a23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.886754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06da12d1-7c6f-462e-975f-ef7762995a23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.887176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06da12d1-7c6f-462e-975f-ef7762995a23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.887874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06da12d1-7c6f-462e-975f-ef7762995a23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.888361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06da12d1-7c6f-462e-975f-ef7762995a23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.888784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06da12d1-7c6f-462e-975f-ef7762995a23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.921390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-06da12d1-7c6f-462e-975f-ef7762995a23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048627 Aug 29 22:53:50.922877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 876/1752] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:51.099049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1fd6957d-b4ce-4a16-b1f6-27b05aaa1269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:51.102569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1fd6957d-b4ce-4a16-b1f6-27b05aaa1269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:51.112321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fd6957d-b4ce-4a16-b1f6-27b05aaa1269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.112321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fd6957d-b4ce-4a16-b1f6-27b05aaa1269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.112321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fd6957d-b4ce-4a16-b1f6-27b05aaa1269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.112321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fd6957d-b4ce-4a16-b1f6-27b05aaa1269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.112842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fd6957d-b4ce-4a16-b1f6-27b05aaa1269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.112842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1fd6957d-b4ce-4a16-b1f6-27b05aaa1269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.148622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1fd6957d-b4ce-4a16-b1f6-27b05aaa1269 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054487 Aug 29 22:53:51.149236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 877/1753] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:51.674101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:51.674707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:51.681095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.681572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.682000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.682701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.683148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.683733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.724016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-18d1a35b-99a4-4651-b887-b944ea829e17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:51.726375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-18d1a35b-99a4-4651-b887-b944ea829e17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:51.732946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d1a35b-99a4-4651-b887-b944ea829e17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.733425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d1a35b-99a4-4651-b887-b944ea829e17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.733852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d1a35b-99a4-4651-b887-b944ea829e17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.734553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d1a35b-99a4-4651-b887-b944ea829e17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.735664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d1a35b-99a4-4651-b887-b944ea829e17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.736062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d1a35b-99a4-4651-b887-b944ea829e17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.751399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:51.759516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-38d8ba5f-e761-414b-9929-5905d5e7fd65 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089799 Aug 29 22:53:51.760250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 877/1754] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:51 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:51.769969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-18d1a35b-99a4-4651-b887-b944ea829e17 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050107 Aug 29 22:53:51.770628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 878/1755] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:51.935285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-97b1f9ed-201b-449f-b753-71b7e8745ca0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:51.937411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-97b1f9ed-201b-449f-b753-71b7e8745ca0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:51.944318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97b1f9ed-201b-449f-b753-71b7e8745ca0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.944766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97b1f9ed-201b-449f-b753-71b7e8745ca0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.945193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97b1f9ed-201b-449f-b753-71b7e8745ca0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.945939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97b1f9ed-201b-449f-b753-71b7e8745ca0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.946391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97b1f9ed-201b-449f-b753-71b7e8745ca0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.946808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97b1f9ed-201b-449f-b753-71b7e8745ca0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.978730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-97b1f9ed-201b-449f-b753-71b7e8745ca0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047503 Aug 29 22:53:51.979310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 878/1756] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:52.161592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4111cc03-1745-4e30-8844-82ae6264c14b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:52.163758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4111cc03-1745-4e30-8844-82ae6264c14b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:52.170326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4111cc03-1745-4e30-8844-82ae6264c14b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.170807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4111cc03-1745-4e30-8844-82ae6264c14b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.171243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4111cc03-1745-4e30-8844-82ae6264c14b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.171935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4111cc03-1745-4e30-8844-82ae6264c14b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.173544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4111cc03-1745-4e30-8844-82ae6264c14b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.173978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4111cc03-1745-4e30-8844-82ae6264c14b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.205720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4111cc03-1745-4e30-8844-82ae6264c14b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048566 Aug 29 22:53:52.206209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 879/1757] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:52.782850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:52.783560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:52.789773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.790273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.790714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.791415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.791872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.792335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.833320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-86ec3893-86f8-4cb8-8262-ef9b009c76da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:52.835506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-86ec3893-86f8-4cb8-8262-ef9b009c76da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:52.841584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86ec3893-86f8-4cb8-8262-ef9b009c76da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.842065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86ec3893-86f8-4cb8-8262-ef9b009c76da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.842500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86ec3893-86f8-4cb8-8262-ef9b009c76da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.843201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86ec3893-86f8-4cb8-8262-ef9b009c76da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.843649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86ec3893-86f8-4cb8-8262-ef9b009c76da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.844990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86ec3893-86f8-4cb8-8262-ef9b009c76da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.855888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:52.864698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-aa2bcf1a-f7c3-4969-b38b-94c0ea7621cc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086360 Aug 29 22:53:52.865282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 879/1758] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:52 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:52.877373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-86ec3893-86f8-4cb8-8262-ef9b009c76da tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098701 Aug 29 22:53:52.878243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 880/1759] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:52.991206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3c43c8dd-9dae-494d-859c-2d3bfca92e32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:52.993483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3c43c8dd-9dae-494d-859c-2d3bfca92e32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:52.999726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c43c8dd-9dae-494d-859c-2d3bfca92e32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.000452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c43c8dd-9dae-494d-859c-2d3bfca92e32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.000905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c43c8dd-9dae-494d-859c-2d3bfca92e32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.001729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c43c8dd-9dae-494d-859c-2d3bfca92e32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.002198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c43c8dd-9dae-494d-859c-2d3bfca92e32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.002628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c43c8dd-9dae-494d-859c-2d3bfca92e32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.036502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3c43c8dd-9dae-494d-859c-2d3bfca92e32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049103 Aug 29 22:53:53.037130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 880/1760] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:53.218032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-64ead5a2-6cfe-401d-acc6-528b56e77219 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:53.221017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-64ead5a2-6cfe-401d-acc6-528b56e77219 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:53.227798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ead5a2-6cfe-401d-acc6-528b56e77219 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.228325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ead5a2-6cfe-401d-acc6-528b56e77219 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.228769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ead5a2-6cfe-401d-acc6-528b56e77219 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.229490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ead5a2-6cfe-401d-acc6-528b56e77219 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.229941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ead5a2-6cfe-401d-acc6-528b56e77219 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.230364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ead5a2-6cfe-401d-acc6-528b56e77219 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.262751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-64ead5a2-6cfe-401d-acc6-528b56e77219 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048680 Aug 29 22:53:53.263330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 881/1761] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:53.887202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:53.887844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:53.889949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-554948ae-aa05-41b9-a09c-0a4fb1c1036e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:53.892399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-554948ae-aa05-41b9-a09c-0a4fb1c1036e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:53.895315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.895829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.896300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.896993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.897444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.897864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.899449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-554948ae-aa05-41b9-a09c-0a4fb1c1036e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.899934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-554948ae-aa05-41b9-a09c-0a4fb1c1036e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.900415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-554948ae-aa05-41b9-a09c-0a4fb1c1036e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.901120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-554948ae-aa05-41b9-a09c-0a4fb1c1036e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.901564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-554948ae-aa05-41b9-a09c-0a4fb1c1036e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.901991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-554948ae-aa05-41b9-a09c-0a4fb1c1036e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.920311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:53.935964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-554948ae-aa05-41b9-a09c-0a4fb1c1036e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049950 Aug 29 22:53:53.940055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 882/1762] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:53.969316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:53.977444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9747c692-20c2-49c5-84f9-6265b24f4026 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094482 Aug 29 22:53:53.978114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 881/1763] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:53 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:54.049945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-52f6447e-5da8-46ca-a8ba-03a9a2ab74a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:54.052272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-52f6447e-5da8-46ca-a8ba-03a9a2ab74a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:54.058950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-52f6447e-5da8-46ca-a8ba-03a9a2ab74a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.059435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-52f6447e-5da8-46ca-a8ba-03a9a2ab74a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.059871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-52f6447e-5da8-46ca-a8ba-03a9a2ab74a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.060681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-52f6447e-5da8-46ca-a8ba-03a9a2ab74a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.061140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-52f6447e-5da8-46ca-a8ba-03a9a2ab74a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.061568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-52f6447e-5da8-46ca-a8ba-03a9a2ab74a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.092547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-52f6447e-5da8-46ca-a8ba-03a9a2ab74a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047243 Aug 29 22:53:54.093108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 883/1764] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:54.275257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7087bde4-9414-49cf-8280-b46084c1b656 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:54.277421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7087bde4-9414-49cf-8280-b46084c1b656 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:54.283966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7087bde4-9414-49cf-8280-b46084c1b656 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.284539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7087bde4-9414-49cf-8280-b46084c1b656 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.284971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7087bde4-9414-49cf-8280-b46084c1b656 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.285658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7087bde4-9414-49cf-8280-b46084c1b656 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.286109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7087bde4-9414-49cf-8280-b46084c1b656 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.286526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7087bde4-9414-49cf-8280-b46084c1b656 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.317073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7087bde4-9414-49cf-8280-b46084c1b656 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045701 Aug 29 22:53:54.317622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 882/1765] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:54.951234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9ea5906d-ed61-4a83-869e-32fe7de36ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:54.954719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9ea5906d-ed61-4a83-869e-32fe7de36ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:54.961543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ea5906d-ed61-4a83-869e-32fe7de36ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.962021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ea5906d-ed61-4a83-869e-32fe7de36ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.962452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ea5906d-ed61-4a83-869e-32fe7de36ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.963149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ea5906d-ed61-4a83-869e-32fe7de36ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.963595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ea5906d-ed61-4a83-869e-32fe7de36ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.964015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ea5906d-ed61-4a83-869e-32fe7de36ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.994504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9ea5906d-ed61-4a83-869e-32fe7de36ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048976 Aug 29 22:53:54.995082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 884/1766] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:54.999420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:55.000040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:55.009035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.009546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.009982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.010678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.011131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.011553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.076750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:55.085873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6b794ff0-5f7b-49dc-a730-839965dfd113 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090317 Aug 29 22:53:55.086448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 883/1767] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:54 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:55.105712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dc48b90d-b7ea-4def-9a07-9a944eecbf7c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:55.107875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dc48b90d-b7ea-4def-9a07-9a944eecbf7c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:55.114371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc48b90d-b7ea-4def-9a07-9a944eecbf7c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.114847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc48b90d-b7ea-4def-9a07-9a944eecbf7c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.115275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc48b90d-b7ea-4def-9a07-9a944eecbf7c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.115984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc48b90d-b7ea-4def-9a07-9a944eecbf7c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.116471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc48b90d-b7ea-4def-9a07-9a944eecbf7c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.116847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc48b90d-b7ea-4def-9a07-9a944eecbf7c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.147805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dc48b90d-b7ea-4def-9a07-9a944eecbf7c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046043 Aug 29 22:53:55.148431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 885/1768] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:55.329791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eb725a27-6da5-4904-97ca-30161846d642 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:55.331928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eb725a27-6da5-4904-97ca-30161846d642 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:55.337951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb725a27-6da5-4904-97ca-30161846d642 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.338429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb725a27-6da5-4904-97ca-30161846d642 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.338864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb725a27-6da5-4904-97ca-30161846d642 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.339557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb725a27-6da5-4904-97ca-30161846d642 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.340012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb725a27-6da5-4904-97ca-30161846d642 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.340460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb725a27-6da5-4904-97ca-30161846d642 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.372121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eb725a27-6da5-4904-97ca-30161846d642 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046761 Aug 29 22:53:55.372713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 884/1769] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:56.007211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-69ba59ee-4857-4ad7-a5be-cec5356b6b99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:56.009387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-69ba59ee-4857-4ad7-a5be-cec5356b6b99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:56.017100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69ba59ee-4857-4ad7-a5be-cec5356b6b99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.017703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69ba59ee-4857-4ad7-a5be-cec5356b6b99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.018141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69ba59ee-4857-4ad7-a5be-cec5356b6b99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.018850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69ba59ee-4857-4ad7-a5be-cec5356b6b99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.019304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69ba59ee-4857-4ad7-a5be-cec5356b6b99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.019734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69ba59ee-4857-4ad7-a5be-cec5356b6b99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.051386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-69ba59ee-4857-4ad7-a5be-cec5356b6b99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048192 Aug 29 22:53:56.051975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 886/1770] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:56.106900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:56.107497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:56.114785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.115208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.115644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.116374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.116858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.117282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.161243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9750d665-f6dd-4195-98e2-d71a02e90bed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:56.163449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9750d665-f6dd-4195-98e2-d71a02e90bed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:56.169671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9750d665-f6dd-4195-98e2-d71a02e90bed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.170149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9750d665-f6dd-4195-98e2-d71a02e90bed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.170577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9750d665-f6dd-4195-98e2-d71a02e90bed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.171269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9750d665-f6dd-4195-98e2-d71a02e90bed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.171800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9750d665-f6dd-4195-98e2-d71a02e90bed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.172482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9750d665-f6dd-4195-98e2-d71a02e90bed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.180847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:56.189192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f84012af-3a06-479b-bcc4-5ef059b507d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086169 Aug 29 22:53:56.189778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 885/1771] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:56 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:56.205884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9750d665-f6dd-4195-98e2-d71a02e90bed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049360 Aug 29 22:53:56.206468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 887/1772] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:56.385443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0199b765-1e2d-4f06-be89-60b6e7220ee4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:56.387637 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0199b765-1e2d-4f06-be89-60b6e7220ee4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:56.395054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0199b765-1e2d-4f06-be89-60b6e7220ee4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.395533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0199b765-1e2d-4f06-be89-60b6e7220ee4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.395972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0199b765-1e2d-4f06-be89-60b6e7220ee4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.396704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0199b765-1e2d-4f06-be89-60b6e7220ee4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.397161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0199b765-1e2d-4f06-be89-60b6e7220ee4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.397585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0199b765-1e2d-4f06-be89-60b6e7220ee4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.430543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0199b765-1e2d-4f06-be89-60b6e7220ee4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048996 Aug 29 22:53:56.431135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 886/1773] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:57.065075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-74b14762-cc54-4f82-a3f7-430d409cd125 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:57.067275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-74b14762-cc54-4f82-a3f7-430d409cd125 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:57.073934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74b14762-cc54-4f82-a3f7-430d409cd125 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.074418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74b14762-cc54-4f82-a3f7-430d409cd125 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.074855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74b14762-cc54-4f82-a3f7-430d409cd125 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.075554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74b14762-cc54-4f82-a3f7-430d409cd125 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.076084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74b14762-cc54-4f82-a3f7-430d409cd125 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.076469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-74b14762-cc54-4f82-a3f7-430d409cd125 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.108320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-74b14762-cc54-4f82-a3f7-430d409cd125 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048188 Aug 29 22:53:57.113601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 888/1774] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:57.211022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:57.213411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:57.221157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.221548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-808840e5-63b2-4fd3-be7a-622ec8316cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:57.221731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.222078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.222816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.223526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.223865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.224037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-808840e5-63b2-4fd3-be7a-622ec8316cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:57.230122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-808840e5-63b2-4fd3-be7a-622ec8316cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.230660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-808840e5-63b2-4fd3-be7a-622ec8316cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.231093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-808840e5-63b2-4fd3-be7a-622ec8316cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.231820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-808840e5-63b2-4fd3-be7a-622ec8316cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.232430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-808840e5-63b2-4fd3-be7a-622ec8316cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.232921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-808840e5-63b2-4fd3-be7a-622ec8316cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.270111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-808840e5-63b2-4fd3-be7a-622ec8316cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055030 Aug 29 22:53:57.270806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 889/1775] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:57.293508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:57.294464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:57.301963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a92ce2ab-6d08-4194-80bd-2ce792a6704c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094954 Aug 29 22:53:57.302556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 887/1776] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:57 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:57.443466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f932fe19-cbb8-43d0-8ab1-efcadc52295b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:57.445774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f932fe19-cbb8-43d0-8ab1-efcadc52295b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:57.451707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f932fe19-cbb8-43d0-8ab1-efcadc52295b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.452214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f932fe19-cbb8-43d0-8ab1-efcadc52295b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.452642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f932fe19-cbb8-43d0-8ab1-efcadc52295b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.454555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f932fe19-cbb8-43d0-8ab1-efcadc52295b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.455119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f932fe19-cbb8-43d0-8ab1-efcadc52295b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.455540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f932fe19-cbb8-43d0-8ab1-efcadc52295b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.487737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f932fe19-cbb8-43d0-8ab1-efcadc52295b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048223 Aug 29 22:53:57.488357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 890/1777] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:58.121983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-265bdf65-658c-4c94-a171-dcf0fdd67cc1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:58.124113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-265bdf65-658c-4c94-a171-dcf0fdd67cc1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:58.131256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-265bdf65-658c-4c94-a171-dcf0fdd67cc1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.131731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-265bdf65-658c-4c94-a171-dcf0fdd67cc1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.132179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-265bdf65-658c-4c94-a171-dcf0fdd67cc1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.132872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-265bdf65-658c-4c94-a171-dcf0fdd67cc1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.133321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-265bdf65-658c-4c94-a171-dcf0fdd67cc1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.133741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-265bdf65-658c-4c94-a171-dcf0fdd67cc1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.164485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-265bdf65-658c-4c94-a171-dcf0fdd67cc1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046851 Aug 29 22:53:58.165296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 888/1778] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:58.283358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5e7d6cc9-f2ef-45fb-9d9f-9727721f10d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:58.285624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5e7d6cc9-f2ef-45fb-9d9f-9727721f10d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:58.292234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e7d6cc9-f2ef-45fb-9d9f-9727721f10d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.292716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e7d6cc9-f2ef-45fb-9d9f-9727721f10d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.293147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e7d6cc9-f2ef-45fb-9d9f-9727721f10d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.293837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e7d6cc9-f2ef-45fb-9d9f-9727721f10d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.294282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e7d6cc9-f2ef-45fb-9d9f-9727721f10d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.294700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e7d6cc9-f2ef-45fb-9d9f-9727721f10d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.323736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:58.324518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:58.328739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5e7d6cc9-f2ef-45fb-9d9f-9727721f10d5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049177 Aug 29 22:53:58.329324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 891/1779] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:58.331829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.332448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.333186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.333987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.334445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.334879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.405926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:58.413865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-29012f6c-e86f-434c-8df1-b88085886025 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093940 Aug 29 22:53:58.414446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 889/1780] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:58 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:58.500902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6eb2bd8b-06f7-4077-bd05-f1edd669f27c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:58.503197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6eb2bd8b-06f7-4077-bd05-f1edd669f27c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:58.510301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb2bd8b-06f7-4077-bd05-f1edd669f27c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.510786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb2bd8b-06f7-4077-bd05-f1edd669f27c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.511224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb2bd8b-06f7-4077-bd05-f1edd669f27c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.511922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb2bd8b-06f7-4077-bd05-f1edd669f27c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.512411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb2bd8b-06f7-4077-bd05-f1edd669f27c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.512836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6eb2bd8b-06f7-4077-bd05-f1edd669f27c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.543222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6eb2bd8b-06f7-4077-bd05-f1edd669f27c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046963 Aug 29 22:53:58.543794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 892/1781] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:59.177466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-363dc05f-0ace-43c3-9c81-85117a402714 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:59.179703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-363dc05f-0ace-43c3-9c81-85117a402714 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:59.185886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-363dc05f-0ace-43c3-9c81-85117a402714 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.186401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-363dc05f-0ace-43c3-9c81-85117a402714 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.186839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-363dc05f-0ace-43c3-9c81-85117a402714 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.187567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-363dc05f-0ace-43c3-9c81-85117a402714 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.188492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-363dc05f-0ace-43c3-9c81-85117a402714 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.188916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-363dc05f-0ace-43c3-9c81-85117a402714 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.220821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-363dc05f-0ace-43c3-9c81-85117a402714 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047411 Aug 29 22:53:59.221388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 890/1782] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:53:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:59.340593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d5259141-7bdc-497e-8879-ea0d9094169c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:59.342780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d5259141-7bdc-497e-8879-ea0d9094169c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:59.349548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5259141-7bdc-497e-8879-ea0d9094169c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.350032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5259141-7bdc-497e-8879-ea0d9094169c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.350472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5259141-7bdc-497e-8879-ea0d9094169c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.351175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5259141-7bdc-497e-8879-ea0d9094169c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.351631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5259141-7bdc-497e-8879-ea0d9094169c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.352079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5259141-7bdc-497e-8879-ea0d9094169c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.383453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d5259141-7bdc-497e-8879-ea0d9094169c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 Aug 29 22:53:59.384063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 893/1783] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:59.436027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:59.436573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:59.443914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.444441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.444885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.445601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.446063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.446493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.524738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:59.532777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-52761b12-16d6-4fa1-8aa4-f592c0ec0181 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.101284 Aug 29 22:53:59.533391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 891/1784] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:59 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:59.556196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82c343a4-bdf6-4df2-9cdd-f4083ded6e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:59.558496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82c343a4-bdf6-4df2-9cdd-f4083ded6e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:59.565423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82c343a4-bdf6-4df2-9cdd-f4083ded6e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.565902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82c343a4-bdf6-4df2-9cdd-f4083ded6e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.566340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82c343a4-bdf6-4df2-9cdd-f4083ded6e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.567052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82c343a4-bdf6-4df2-9cdd-f4083ded6e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.567511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82c343a4-bdf6-4df2-9cdd-f4083ded6e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.567934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82c343a4-bdf6-4df2-9cdd-f4083ded6e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.600801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82c343a4-bdf6-4df2-9cdd-f4083ded6e58 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048499 Aug 29 22:53:59.601386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 894/1785] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:00.233767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d418e97a-5a08-4954-9df4-d93ce48d8053 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:00.236755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d418e97a-5a08-4954-9df4-d93ce48d8053 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:00.243298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d418e97a-5a08-4954-9df4-d93ce48d8053 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.243803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d418e97a-5a08-4954-9df4-d93ce48d8053 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.244281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d418e97a-5a08-4954-9df4-d93ce48d8053 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.245015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d418e97a-5a08-4954-9df4-d93ce48d8053 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.245510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d418e97a-5a08-4954-9df4-d93ce48d8053 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.245907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d418e97a-5a08-4954-9df4-d93ce48d8053 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.278993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d418e97a-5a08-4954-9df4-d93ce48d8053 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049115 Aug 29 22:54:00.279480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 892/1786] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:00.396634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e2448234-0119-485e-b594-25d0d68eb962 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:00.400314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e2448234-0119-485e-b594-25d0d68eb962 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:00.408008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2448234-0119-485e-b594-25d0d68eb962 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.408538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2448234-0119-485e-b594-25d0d68eb962 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.408981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2448234-0119-485e-b594-25d0d68eb962 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.409702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2448234-0119-485e-b594-25d0d68eb962 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.410163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2448234-0119-485e-b594-25d0d68eb962 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.410593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e2448234-0119-485e-b594-25d0d68eb962 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.442616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e2448234-0119-485e-b594-25d0d68eb962 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049914 Aug 29 22:54:00.443209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 895/1787] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:00.554535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:00.555081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:00.561911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.562414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.563720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.564470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.564942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.565406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.614561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac979b76-e2bc-46a9-978d-14c5f5089e64 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:00.616790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac979b76-e2bc-46a9-978d-14c5f5089e64 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:00.623216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac979b76-e2bc-46a9-978d-14c5f5089e64 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.623705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac979b76-e2bc-46a9-978d-14c5f5089e64 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.624148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac979b76-e2bc-46a9-978d-14c5f5089e64 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.624861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac979b76-e2bc-46a9-978d-14c5f5089e64 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.625911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac979b76-e2bc-46a9-978d-14c5f5089e64 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.626341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac979b76-e2bc-46a9-978d-14c5f5089e64 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.633116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:00.641358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fb0973ba-440a-48d4-9cd0-eae03a5e6d40 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090881 Aug 29 22:54:00.642034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 893/1788] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:00 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:00.660887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac979b76-e2bc-46a9-978d-14c5f5089e64 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051035 Aug 29 22:54:00.661470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 896/1789] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:01.293047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e8da643c-730d-4e1a-9b1d-448c6b53dcd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:01.295108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e8da643c-730d-4e1a-9b1d-448c6b53dcd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:01.301602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8da643c-730d-4e1a-9b1d-448c6b53dcd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.302085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8da643c-730d-4e1a-9b1d-448c6b53dcd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.302519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8da643c-730d-4e1a-9b1d-448c6b53dcd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.303218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8da643c-730d-4e1a-9b1d-448c6b53dcd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.303671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8da643c-730d-4e1a-9b1d-448c6b53dcd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.304094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8da643c-730d-4e1a-9b1d-448c6b53dcd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.336404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e8da643c-730d-4e1a-9b1d-448c6b53dcd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047755 Aug 29 22:54:01.336991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 894/1790] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:01.455701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-09a6d9ca-7152-48fa-9d00-4731d5f73338 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:01.457903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-09a6d9ca-7152-48fa-9d00-4731d5f73338 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:01.464432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09a6d9ca-7152-48fa-9d00-4731d5f73338 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.464913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09a6d9ca-7152-48fa-9d00-4731d5f73338 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.465340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09a6d9ca-7152-48fa-9d00-4731d5f73338 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.466037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09a6d9ca-7152-48fa-9d00-4731d5f73338 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.466483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09a6d9ca-7152-48fa-9d00-4731d5f73338 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.466903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09a6d9ca-7152-48fa-9d00-4731d5f73338 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.499463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-09a6d9ca-7152-48fa-9d00-4731d5f73338 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048343 Aug 29 22:54:01.500112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 897/1791] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:01.662272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:01.662891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:01.669680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.670174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.670611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.671320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.671775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.672248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.673372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7afda6a2-357c-427d-a333-832995c104e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:01.678084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7afda6a2-357c-427d-a333-832995c104e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:01.682855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7afda6a2-357c-427d-a333-832995c104e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.685869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7afda6a2-357c-427d-a333-832995c104e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.685869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7afda6a2-357c-427d-a333-832995c104e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.685869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7afda6a2-357c-427d-a333-832995c104e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.685869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7afda6a2-357c-427d-a333-832995c104e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.686288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7afda6a2-357c-427d-a333-832995c104e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.718187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7afda6a2-357c-427d-a333-832995c104e3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048719 Aug 29 22:54:01.718766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 898/1792] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:01.740620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:01.748432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5bffcf97-1482-4bd4-8b75-3f60f4fa48ee tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090109 Aug 29 22:54:01.749007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 895/1793] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:01 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:02.350247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eef12c15-e6e4-44ef-a504-964a761c9a42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:02.352349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eef12c15-e6e4-44ef-a504-964a761c9a42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:02.358425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eef12c15-e6e4-44ef-a504-964a761c9a42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.358908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eef12c15-e6e4-44ef-a504-964a761c9a42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.359363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eef12c15-e6e4-44ef-a504-964a761c9a42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.360761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eef12c15-e6e4-44ef-a504-964a761c9a42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.361220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eef12c15-e6e4-44ef-a504-964a761c9a42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.361646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eef12c15-e6e4-44ef-a504-964a761c9a42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.365575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:02.393574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eef12c15-e6e4-44ef-a504-964a761c9a42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047381 Aug 29 22:54:02.394166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 899/1794] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:54:02.513276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cdf74f64-f993-4c41-b187-d06701100080 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:02.515424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cdf74f64-f993-4c41-b187-d06701100080 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:02.522041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdf74f64-f993-4c41-b187-d06701100080 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.522526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdf74f64-f993-4c41-b187-d06701100080 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.522962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdf74f64-f993-4c41-b187-d06701100080 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.523664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdf74f64-f993-4c41-b187-d06701100080 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.524119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdf74f64-f993-4c41-b187-d06701100080 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.524568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdf74f64-f993-4c41-b187-d06701100080 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.556959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cdf74f64-f993-4c41-b187-d06701100080 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047564 Aug 29 22:54:02.557530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 896/1795] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:02.771955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:02.772607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:02.779362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.779682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.780128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.780871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.781949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.782404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.803319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82510931-1de5-4e6d-9de5-3d71442e0259 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:02.805537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82510931-1de5-4e6d-9de5-3d71442e0259 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:02.812113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82510931-1de5-4e6d-9de5-3d71442e0259 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.812667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82510931-1de5-4e6d-9de5-3d71442e0259 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.813181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82510931-1de5-4e6d-9de5-3d71442e0259 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.813894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82510931-1de5-4e6d-9de5-3d71442e0259 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.814585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82510931-1de5-4e6d-9de5-3d71442e0259 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.814776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82510931-1de5-4e6d-9de5-3d71442e0259 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.849358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82510931-1de5-4e6d-9de5-3d71442e0259 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122240 Aug 29 22:54:02.849964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 900/1796] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:02.862569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:02.870710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a113b816-d6fa-4e49-aec6-06de1f7fc3c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.104771 Aug 29 22:54:02.871292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 897/1797] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:02 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:03.406683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fbd29b9e-a6ec-44e8-8711-c7063f424323 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:03.409204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fbd29b9e-a6ec-44e8-8711-c7063f424323 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:03.415777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd29b9e-a6ec-44e8-8711-c7063f424323 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.416291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd29b9e-a6ec-44e8-8711-c7063f424323 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.416722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd29b9e-a6ec-44e8-8711-c7063f424323 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.417412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd29b9e-a6ec-44e8-8711-c7063f424323 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.417857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd29b9e-a6ec-44e8-8711-c7063f424323 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.418280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fbd29b9e-a6ec-44e8-8711-c7063f424323 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.451515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fbd29b9e-a6ec-44e8-8711-c7063f424323 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049117 Aug 29 22:54:03.452119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 901/1798] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:03.570056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b2a45a9b-4758-469b-a527-561cd77deb3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:03.572286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b2a45a9b-4758-469b-a527-561cd77deb3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:03.579132 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a45a9b-4758-469b-a527-561cd77deb3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.579854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a45a9b-4758-469b-a527-561cd77deb3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.580388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a45a9b-4758-469b-a527-561cd77deb3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.581108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a45a9b-4758-469b-a527-561cd77deb3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.581560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a45a9b-4758-469b-a527-561cd77deb3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.581991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a45a9b-4758-469b-a527-561cd77deb3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.616435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b2a45a9b-4758-469b-a527-561cd77deb3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050332 Aug 29 22:54:03.617029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 898/1799] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:03.863992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ae867d80-2bec-467f-9793-19a6346dea82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:03.866076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ae867d80-2bec-467f-9793-19a6346dea82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:03.872887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae867d80-2bec-467f-9793-19a6346dea82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.873383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae867d80-2bec-467f-9793-19a6346dea82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.873811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae867d80-2bec-467f-9793-19a6346dea82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.874511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae867d80-2bec-467f-9793-19a6346dea82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.875483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae867d80-2bec-467f-9793-19a6346dea82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.876169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae867d80-2bec-467f-9793-19a6346dea82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.894581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:03.895196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:03.901779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.902262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.902696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.903395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.903845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.904296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.918240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ae867d80-2bec-467f-9793-19a6346dea82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058493 Aug 29 22:54:03.919820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 902/1800] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:03.988236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:03.996498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0fd2c69b-b745-43d5-b52b-d76e3e1ff752 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.107130 Aug 29 22:54:03.997081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 899/1801] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:03 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:04.464445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e966de64-7d9a-4f0c-a93a-6c355deafe88 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:04.466679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e966de64-7d9a-4f0c-a93a-6c355deafe88 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:04.473474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e966de64-7d9a-4f0c-a93a-6c355deafe88 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:04.473956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e966de64-7d9a-4f0c-a93a-6c355deafe88 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:04.474387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e966de64-7d9a-4f0c-a93a-6c355deafe88 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:04.475089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e966de64-7d9a-4f0c-a93a-6c355deafe88 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:04.475550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e966de64-7d9a-4f0c-a93a-6c355deafe88 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:04.475972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e966de64-7d9a-4f0c-a93a-6c355deafe88 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:04.509382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e966de64-7d9a-4f0c-a93a-6c355deafe88 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048876 Aug 29 22:54:04.509970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 903/1802] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:04.629643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f713d268-0618-4687-b48a-a51d833239ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:04.631826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f713d268-0618-4687-b48a-a51d833239ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:04.638077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f713d268-0618-4687-b48a-a51d833239ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:04.638579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f713d268-0618-4687-b48a-a51d833239ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:04.639015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f713d268-0618-4687-b48a-a51d833239ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:04.639709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f713d268-0618-4687-b48a-a51d833239ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:04.640196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f713d268-0618-4687-b48a-a51d833239ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:04.641227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f713d268-0618-4687-b48a-a51d833239ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:04.675650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f713d268-0618-4687-b48a-a51d833239ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050499 Aug 29 22:54:04.676577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 900/1803] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:04.935993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2273e367-a161-40e0-88ed-b45bef21d9dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:04.939710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2273e367-a161-40e0-88ed-b45bef21d9dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:04.951047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2273e367-a161-40e0-88ed-b45bef21d9dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:04.951916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2273e367-a161-40e0-88ed-b45bef21d9dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:04.952713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2273e367-a161-40e0-88ed-b45bef21d9dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:04.954463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2273e367-a161-40e0-88ed-b45bef21d9dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:04.955280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2273e367-a161-40e0-88ed-b45bef21d9dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:04.956078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2273e367-a161-40e0-88ed-b45bef21d9dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.012529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2273e367-a161-40e0-88ed-b45bef21d9dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083443 Aug 29 22:54:05.013488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 904/1804] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:05.020394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:05.021046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:05.027619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.028103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.028569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.029287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.029737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.030143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.096526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:05.105088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f00eaa50-e5e6-4220-b896-0deffba9abe4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089981 Aug 29 22:54:05.105672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 901/1805] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:05 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:05.522163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6420b2d9-4d73-4cb9-9a06-456d049a6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:05.524354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6420b2d9-4d73-4cb9-9a06-456d049a6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:05.530559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6420b2d9-4d73-4cb9-9a06-456d049a6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.531038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6420b2d9-4d73-4cb9-9a06-456d049a6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.532174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6420b2d9-4d73-4cb9-9a06-456d049a6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.532895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6420b2d9-4d73-4cb9-9a06-456d049a6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.533345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6420b2d9-4d73-4cb9-9a06-456d049a6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.533776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6420b2d9-4d73-4cb9-9a06-456d049a6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.565845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6420b2d9-4d73-4cb9-9a06-456d049a6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047645 Aug 29 22:54:05.566440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 905/1806] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:05.688814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3fc6cc54-620b-480d-b4e7-39db0be7bdc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:05.691000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3fc6cc54-620b-480d-b4e7-39db0be7bdc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:05.697260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fc6cc54-620b-480d-b4e7-39db0be7bdc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.697742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fc6cc54-620b-480d-b4e7-39db0be7bdc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.698178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fc6cc54-620b-480d-b4e7-39db0be7bdc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.698879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fc6cc54-620b-480d-b4e7-39db0be7bdc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.699334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fc6cc54-620b-480d-b4e7-39db0be7bdc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.699753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3fc6cc54-620b-480d-b4e7-39db0be7bdc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.735742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3fc6cc54-620b-480d-b4e7-39db0be7bdc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051321 Aug 29 22:54:05.736373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 902/1807] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:05 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:06.026416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-04262d87-2a3f-47ad-a6cc-3fe69f83e4fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:06.028609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-04262d87-2a3f-47ad-a6cc-3fe69f83e4fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:06.036602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04262d87-2a3f-47ad-a6cc-3fe69f83e4fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.037085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04262d87-2a3f-47ad-a6cc-3fe69f83e4fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.037527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04262d87-2a3f-47ad-a6cc-3fe69f83e4fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:06.038223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04262d87-2a3f-47ad-a6cc-3fe69f83e4fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.038670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04262d87-2a3f-47ad-a6cc-3fe69f83e4fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.039088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04262d87-2a3f-47ad-a6cc-3fe69f83e4fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:06.071365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-04262d87-2a3f-47ad-a6cc-3fe69f83e4fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048953 Aug 29 22:54:06.071940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 906/1808] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:06.126828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:06.127383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:06.134459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.134949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.135386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:06.136088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.136587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.137014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:06.207054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:06.216063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c367b1ff-ab4b-4032-9d9e-5230528ebac1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093717 Aug 29 22:54:06.216673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 903/1809] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:06 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:06.580063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bae524bb-e47e-4951-99dc-7864adb284c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:06.582717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bae524bb-e47e-4951-99dc-7864adb284c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:06.589612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bae524bb-e47e-4951-99dc-7864adb284c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.590090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bae524bb-e47e-4951-99dc-7864adb284c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.590519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bae524bb-e47e-4951-99dc-7864adb284c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:06.591208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bae524bb-e47e-4951-99dc-7864adb284c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.591659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bae524bb-e47e-4951-99dc-7864adb284c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.592073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bae524bb-e47e-4951-99dc-7864adb284c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:06.625094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bae524bb-e47e-4951-99dc-7864adb284c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050227 Aug 29 22:54:06.626081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 907/1810] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:06.748900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-688319d9-ccb1-43b7-94dd-58d821beac14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:06.751216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-688319d9-ccb1-43b7-94dd-58d821beac14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:06.757681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688319d9-ccb1-43b7-94dd-58d821beac14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.758165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688319d9-ccb1-43b7-94dd-58d821beac14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.758604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688319d9-ccb1-43b7-94dd-58d821beac14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:06.759341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688319d9-ccb1-43b7-94dd-58d821beac14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.759984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688319d9-ccb1-43b7-94dd-58d821beac14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.760446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688319d9-ccb1-43b7-94dd-58d821beac14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:06.775676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:06.793002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-688319d9-ccb1-43b7-94dd-58d821beac14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048395 Aug 29 22:54:06.794966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 904/1811] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:07.085173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eae3cce4-a106-4023-be46-239da02b6374 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:07.087309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eae3cce4-a106-4023-be46-239da02b6374 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:07.094009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eae3cce4-a106-4023-be46-239da02b6374 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.094711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eae3cce4-a106-4023-be46-239da02b6374 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.095149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eae3cce4-a106-4023-be46-239da02b6374 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.095854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eae3cce4-a106-4023-be46-239da02b6374 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.096346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eae3cce4-a106-4023-be46-239da02b6374 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.096774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eae3cce4-a106-4023-be46-239da02b6374 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.128128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eae3cce4-a106-4023-be46-239da02b6374 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047069 Aug 29 22:54:07.128739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 908/1812] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:07.238440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:07.238953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:07.246263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.246753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.247166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.247860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.248344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.248768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.317743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:07.326561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d28b8b44-2535-4222-811d-679500378d18 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092682 Aug 29 22:54:07.327180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 905/1813] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:07 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:07.638589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b7f0052d-a1a4-4d3c-95f9-b670a8b95d1a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:07.640911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b7f0052d-a1a4-4d3c-95f9-b670a8b95d1a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:07.648066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f0052d-a1a4-4d3c-95f9-b670a8b95d1a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.648583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f0052d-a1a4-4d3c-95f9-b670a8b95d1a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.649018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f0052d-a1a4-4d3c-95f9-b670a8b95d1a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.649723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f0052d-a1a4-4d3c-95f9-b670a8b95d1a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.650175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f0052d-a1a4-4d3c-95f9-b670a8b95d1a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.650603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f0052d-a1a4-4d3c-95f9-b670a8b95d1a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.683528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b7f0052d-a1a4-4d3c-95f9-b670a8b95d1a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048910 Aug 29 22:54:07.684102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 909/1814] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:07.805496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9bf5dbf3-3521-4304-90dd-ba2811141cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:07.807674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9bf5dbf3-3521-4304-90dd-ba2811141cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:07.813908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9bf5dbf3-3521-4304-90dd-ba2811141cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.814283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9bf5dbf3-3521-4304-90dd-ba2811141cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.814705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9bf5dbf3-3521-4304-90dd-ba2811141cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.815402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9bf5dbf3-3521-4304-90dd-ba2811141cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:07.815850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9bf5dbf3-3521-4304-90dd-ba2811141cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:07.816304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9bf5dbf3-3521-4304-90dd-ba2811141cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.853974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9bf5dbf3-3521-4304-90dd-ba2811141cbe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052412 Aug 29 22:54:07.854770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 906/1815] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:08.142335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-85327b7a-4271-42be-8fd8-234db7955a0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:08.144550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-85327b7a-4271-42be-8fd8-234db7955a0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:08.151216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85327b7a-4271-42be-8fd8-234db7955a0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.151693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85327b7a-4271-42be-8fd8-234db7955a0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.152125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85327b7a-4271-42be-8fd8-234db7955a0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.152845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85327b7a-4271-42be-8fd8-234db7955a0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.153295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85327b7a-4271-42be-8fd8-234db7955a0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.153719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85327b7a-4271-42be-8fd8-234db7955a0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.185440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-85327b7a-4271-42be-8fd8-234db7955a0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047755 Aug 29 22:54:08.185925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 910/1816] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:08.348025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:08.348652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:08.355182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.355653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.356084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.356796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.357245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.357665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.423629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:08.432942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5edd64b6-77b1-4224-b828-82c4c0a1e087 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088781 Aug 29 22:54:08.433533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 907/1817] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:08 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:08.696534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9b99fd78-9c9a-4b76-b46a-00b5d76df195 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:08.698663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9b99fd78-9c9a-4b76-b46a-00b5d76df195 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:08.705979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b99fd78-9c9a-4b76-b46a-00b5d76df195 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.706458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b99fd78-9c9a-4b76-b46a-00b5d76df195 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.706887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b99fd78-9c9a-4b76-b46a-00b5d76df195 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.707580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b99fd78-9c9a-4b76-b46a-00b5d76df195 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.708025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b99fd78-9c9a-4b76-b46a-00b5d76df195 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.708476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b99fd78-9c9a-4b76-b46a-00b5d76df195 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.742108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9b99fd78-9c9a-4b76-b46a-00b5d76df195 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049510 Aug 29 22:54:08.742683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 911/1818] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:08.867542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-35205860-8fb7-4936-9d8b-111f4c472382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:08.869740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-35205860-8fb7-4936-9d8b-111f4c472382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:08.877052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35205860-8fb7-4936-9d8b-111f4c472382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.877548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35205860-8fb7-4936-9d8b-111f4c472382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.877994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35205860-8fb7-4936-9d8b-111f4c472382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.878694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35205860-8fb7-4936-9d8b-111f4c472382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.879150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35205860-8fb7-4936-9d8b-111f4c472382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.879574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-35205860-8fb7-4936-9d8b-111f4c472382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.913589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-35205860-8fb7-4936-9d8b-111f4c472382 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050199 Aug 29 22:54:08.914163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 908/1819] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:09.197963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3ea406e2-e23f-4788-953a-ccf9bb68be1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:09.200079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3ea406e2-e23f-4788-953a-ccf9bb68be1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:09.207184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ea406e2-e23f-4788-953a-ccf9bb68be1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.207658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ea406e2-e23f-4788-953a-ccf9bb68be1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.208085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ea406e2-e23f-4788-953a-ccf9bb68be1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.208797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ea406e2-e23f-4788-953a-ccf9bb68be1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.209240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ea406e2-e23f-4788-953a-ccf9bb68be1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.209654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ea406e2-e23f-4788-953a-ccf9bb68be1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.241276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3ea406e2-e23f-4788-953a-ccf9bb68be1e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047245 Aug 29 22:54:09.241853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 912/1820] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:09.455779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:09.456342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:09.462992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.463477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.463919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.464660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.465113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.465543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.532268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:09.539857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-64a1e7ee-36ff-4609-a276-9938b3cc1b2a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089103 Aug 29 22:54:09.540468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 909/1821] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:09 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:09.755039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-54c4aa1c-3c80-4db8-9b17-89ad1fa38996 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:09.757048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-54c4aa1c-3c80-4db8-9b17-89ad1fa38996 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:09.763043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54c4aa1c-3c80-4db8-9b17-89ad1fa38996 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.763529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54c4aa1c-3c80-4db8-9b17-89ad1fa38996 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.763962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54c4aa1c-3c80-4db8-9b17-89ad1fa38996 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.764691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54c4aa1c-3c80-4db8-9b17-89ad1fa38996 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.765144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54c4aa1c-3c80-4db8-9b17-89ad1fa38996 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.766070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54c4aa1c-3c80-4db8-9b17-89ad1fa38996 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.798309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-54c4aa1c-3c80-4db8-9b17-89ad1fa38996 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047574 Aug 29 22:54:09.798884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 913/1822] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:09.926463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e8d887e3-63ca-4e44-91ad-123c30dfdc22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:09.928890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e8d887e3-63ca-4e44-91ad-123c30dfdc22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:09.935222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8d887e3-63ca-4e44-91ad-123c30dfdc22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.935743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8d887e3-63ca-4e44-91ad-123c30dfdc22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.936214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8d887e3-63ca-4e44-91ad-123c30dfdc22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.936919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8d887e3-63ca-4e44-91ad-123c30dfdc22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.938056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8d887e3-63ca-4e44-91ad-123c30dfdc22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.938505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8d887e3-63ca-4e44-91ad-123c30dfdc22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.969170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e8d887e3-63ca-4e44-91ad-123c30dfdc22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046719 Aug 29 22:54:09.969758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 910/1823] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:09 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:10.254961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2b6a3e4a-6275-45ca-bb03-42cef14f073c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:10.257239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2b6a3e4a-6275-45ca-bb03-42cef14f073c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:10.263753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b6a3e4a-6275-45ca-bb03-42cef14f073c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.264301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b6a3e4a-6275-45ca-bb03-42cef14f073c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.264742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b6a3e4a-6275-45ca-bb03-42cef14f073c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:10.265479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b6a3e4a-6275-45ca-bb03-42cef14f073c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.265932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b6a3e4a-6275-45ca-bb03-42cef14f073c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.266356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b6a3e4a-6275-45ca-bb03-42cef14f073c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:10.298819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2b6a3e4a-6275-45ca-bb03-42cef14f073c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Aug 29 22:54:10.299320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 914/1824] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:10.561312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:10.561840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:10.569583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.570066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.570499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:10.571203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.571661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.572093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:10.636618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:10.645340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9759a5b3-bca7-4ea0-b7b3-da316c41051c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087898 Aug 29 22:54:10.649122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 911/1825] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:10 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:10.811542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8ce2a648-a2a8-4b7b-842c-6d8d3a1211f8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:10.814179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8ce2a648-a2a8-4b7b-842c-6d8d3a1211f8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:10.816313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:10.821074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce2a648-a2a8-4b7b-842c-6d8d3a1211f8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.821562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce2a648-a2a8-4b7b-842c-6d8d3a1211f8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.821999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce2a648-a2a8-4b7b-842c-6d8d3a1211f8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:10.822755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce2a648-a2a8-4b7b-842c-6d8d3a1211f8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.823212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce2a648-a2a8-4b7b-842c-6d8d3a1211f8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.823634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ce2a648-a2a8-4b7b-842c-6d8d3a1211f8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:10.852400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:10.857686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8ce2a648-a2a8-4b7b-842c-6d8d3a1211f8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050446 Aug 29 22:54:10.858274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 915/1826] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:10.981829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-aaf4e90c-d173-4a59-b3bb-318f1e1c95af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:10.983990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-aaf4e90c-d173-4a59-b3bb-318f1e1c95af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:10.990957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aaf4e90c-d173-4a59-b3bb-318f1e1c95af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.991438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aaf4e90c-d173-4a59-b3bb-318f1e1c95af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.991873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aaf4e90c-d173-4a59-b3bb-318f1e1c95af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:10.992615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aaf4e90c-d173-4a59-b3bb-318f1e1c95af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.993074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aaf4e90c-d173-4a59-b3bb-318f1e1c95af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.993497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aaf4e90c-d173-4a59-b3bb-318f1e1c95af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:11.026721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-aaf4e90c-d173-4a59-b3bb-318f1e1c95af tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048974 Aug 29 22:54:11.027429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 912/1827] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:11.311530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-04675928-fecf-43b2-add1-2114dae362e8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:11.313850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-04675928-fecf-43b2-add1-2114dae362e8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:11.320434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04675928-fecf-43b2-add1-2114dae362e8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:11.320914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04675928-fecf-43b2-add1-2114dae362e8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:11.321341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04675928-fecf-43b2-add1-2114dae362e8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:11.322029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04675928-fecf-43b2-add1-2114dae362e8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:11.322476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04675928-fecf-43b2-add1-2114dae362e8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:11.322904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04675928-fecf-43b2-add1-2114dae362e8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:11.356941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-04675928-fecf-43b2-add1-2114dae362e8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049726 Aug 29 22:54:11.357560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 916/1828] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:11.666330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:11.666942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:11.674623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:11.675107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:11.675542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:11.676279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:11.676731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:11.677157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:11.742334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:11.750236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-91c9bbca-2060-4908-9935-7f9814eed514 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087587 Aug 29 22:54:11.751450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 913/1829] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:11 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:11.870878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-92919db9-27b6-4bcb-954b-026a6acf5e65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:11.873066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-92919db9-27b6-4bcb-954b-026a6acf5e65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:11.881077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92919db9-27b6-4bcb-954b-026a6acf5e65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:11.881677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92919db9-27b6-4bcb-954b-026a6acf5e65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:11.882201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92919db9-27b6-4bcb-954b-026a6acf5e65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:11.882994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92919db9-27b6-4bcb-954b-026a6acf5e65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:11.883531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92919db9-27b6-4bcb-954b-026a6acf5e65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:11.884051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92919db9-27b6-4bcb-954b-026a6acf5e65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:11.917015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-92919db9-27b6-4bcb-954b-026a6acf5e65 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050009 Aug 29 22:54:11.917509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 917/1830] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:54:12.039701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d79d796e-9aea-42c0-b7f2-67d16d9915a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:12.042001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d79d796e-9aea-42c0-b7f2-67d16d9915a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:12.048646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d79d796e-9aea-42c0-b7f2-67d16d9915a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.049128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d79d796e-9aea-42c0-b7f2-67d16d9915a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.049567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d79d796e-9aea-42c0-b7f2-67d16d9915a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.050270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d79d796e-9aea-42c0-b7f2-67d16d9915a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.050724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d79d796e-9aea-42c0-b7f2-67d16d9915a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.051146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d79d796e-9aea-42c0-b7f2-67d16d9915a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.083321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d79d796e-9aea-42c0-b7f2-67d16d9915a3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047608 Aug 29 22:54:12.083917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 914/1831] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:12.370538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-81e20d2b-221f-4001-8c69-4b410f9358f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:12.372746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-81e20d2b-221f-4001-8c69-4b410f9358f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:12.380163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81e20d2b-221f-4001-8c69-4b410f9358f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.380644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81e20d2b-221f-4001-8c69-4b410f9358f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.381070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81e20d2b-221f-4001-8c69-4b410f9358f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.381759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81e20d2b-221f-4001-8c69-4b410f9358f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.382209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81e20d2b-221f-4001-8c69-4b410f9358f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.382622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81e20d2b-221f-4001-8c69-4b410f9358f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.417649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-81e20d2b-221f-4001-8c69-4b410f9358f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051034 Aug 29 22:54:12.418238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 918/1832] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:12.771715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:12.772349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:12.779175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.779662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.780099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.780822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.781905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.782345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.847921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:12.855852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b0ada3e0-1857-445b-b63d-2b68a39f39a1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087956 Aug 29 22:54:12.856470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 915/1833] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:12 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:12.930109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2270c313-dd32-4c51-a01c-47e293c543ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:12.932689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2270c313-dd32-4c51-a01c-47e293c543ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:12.940992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2270c313-dd32-4c51-a01c-47e293c543ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.941667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2270c313-dd32-4c51-a01c-47e293c543ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.942398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2270c313-dd32-4c51-a01c-47e293c543ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.943289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2270c313-dd32-4c51-a01c-47e293c543ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.943903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2270c313-dd32-4c51-a01c-47e293c543ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.944446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2270c313-dd32-4c51-a01c-47e293c543ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.977016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2270c313-dd32-4c51-a01c-47e293c543ac tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051161 Aug 29 22:54:12.977633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 919/1834] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:13.096241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c25a7fc6-67c6-4f7c-b549-b534d728951c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:13.098327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c25a7fc6-67c6-4f7c-b549-b534d728951c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:13.104417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25a7fc6-67c6-4f7c-b549-b534d728951c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.104906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25a7fc6-67c6-4f7c-b549-b534d728951c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.105344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25a7fc6-67c6-4f7c-b549-b534d728951c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.106045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25a7fc6-67c6-4f7c-b549-b534d728951c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.106501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25a7fc6-67c6-4f7c-b549-b534d728951c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.106928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25a7fc6-67c6-4f7c-b549-b534d728951c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.138354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c25a7fc6-67c6-4f7c-b549-b534d728951c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046588 Aug 29 22:54:13.138948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 916/1835] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:13.431291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-03202cb7-e113-4402-b06c-f838515b90d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:13.433521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-03202cb7-e113-4402-b06c-f838515b90d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:13.440413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03202cb7-e113-4402-b06c-f838515b90d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.440896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03202cb7-e113-4402-b06c-f838515b90d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.441332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03202cb7-e113-4402-b06c-f838515b90d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.442033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03202cb7-e113-4402-b06c-f838515b90d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.442488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03202cb7-e113-4402-b06c-f838515b90d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.442935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03202cb7-e113-4402-b06c-f838515b90d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.475360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-03202cb7-e113-4402-b06c-f838515b90d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048248 Aug 29 22:54:13.475940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 920/1836] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:13.877498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:13.877974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:13.884625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.885088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.885528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.886223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.886676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.887099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.954006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:13.965200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1eb92e18-ff1c-4e8d-a24b-2e79d6a59cb2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092338 Aug 29 22:54:13.965781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 917/1837] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:13 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:13.989794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-23a521d8-fa91-4863-8af4-b84f8820847e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:13.991957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-23a521d8-fa91-4863-8af4-b84f8820847e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:13.997917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23a521d8-fa91-4863-8af4-b84f8820847e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.998388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23a521d8-fa91-4863-8af4-b84f8820847e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.998818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23a521d8-fa91-4863-8af4-b84f8820847e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.999590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23a521d8-fa91-4863-8af4-b84f8820847e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.000009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23a521d8-fa91-4863-8af4-b84f8820847e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.000515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23a521d8-fa91-4863-8af4-b84f8820847e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.032351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-23a521d8-fa91-4863-8af4-b84f8820847e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045684 Aug 29 22:54:14.033059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 921/1838] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:14.151793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a37573ec-98b5-4a11-94c3-be864af1bbbd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:14.153953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a37573ec-98b5-4a11-94c3-be864af1bbbd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:14.161090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a37573ec-98b5-4a11-94c3-be864af1bbbd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.161472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a37573ec-98b5-4a11-94c3-be864af1bbbd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.161904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a37573ec-98b5-4a11-94c3-be864af1bbbd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.162638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a37573ec-98b5-4a11-94c3-be864af1bbbd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.163091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a37573ec-98b5-4a11-94c3-be864af1bbbd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.163515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a37573ec-98b5-4a11-94c3-be864af1bbbd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.196268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a37573ec-98b5-4a11-94c3-be864af1bbbd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048434 Aug 29 22:54:14.196842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 918/1839] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:14.488068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-89e6b2ee-aee4-40ac-a02e-998274fb6215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:14.490236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-89e6b2ee-aee4-40ac-a02e-998274fb6215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:14.496889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89e6b2ee-aee4-40ac-a02e-998274fb6215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.497360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89e6b2ee-aee4-40ac-a02e-998274fb6215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.497787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89e6b2ee-aee4-40ac-a02e-998274fb6215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.498480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89e6b2ee-aee4-40ac-a02e-998274fb6215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.498948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89e6b2ee-aee4-40ac-a02e-998274fb6215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.499365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-89e6b2ee-aee4-40ac-a02e-998274fb6215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.534545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-89e6b2ee-aee4-40ac-a02e-998274fb6215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051261 Aug 29 22:54:14.535131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 922/1840] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:14.988127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:14.988770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:14.995971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.996498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.996939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.997644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.998165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.998589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.045831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dd58b989-471e-4193-81c4-64daa3de8522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:15.048837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dd58b989-471e-4193-81c4-64daa3de8522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:15.064250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd58b989-471e-4193-81c4-64daa3de8522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.064743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd58b989-471e-4193-81c4-64daa3de8522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.065184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd58b989-471e-4193-81c4-64daa3de8522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.065888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd58b989-471e-4193-81c4-64daa3de8522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.066347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd58b989-471e-4193-81c4-64daa3de8522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.067231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd58b989-471e-4193-81c4-64daa3de8522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.069292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:15.077386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2b7bab1a-6b20-40cf-a62e-a70960700269 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093786 Aug 29 22:54:15.078619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 919/1841] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:14 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:15.099633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dd58b989-471e-4193-81c4-64daa3de8522 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058285 Aug 29 22:54:15.100229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 923/1842] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:15.209503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e4d46c77-217e-4952-81f3-316b9e584b22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:15.211586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e4d46c77-217e-4952-81f3-316b9e584b22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:15.217718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d46c77-217e-4952-81f3-316b9e584b22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.218206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d46c77-217e-4952-81f3-316b9e584b22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.218697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d46c77-217e-4952-81f3-316b9e584b22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.219415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d46c77-217e-4952-81f3-316b9e584b22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.219872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d46c77-217e-4952-81f3-316b9e584b22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.220434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4d46c77-217e-4952-81f3-316b9e584b22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.253384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e4d46c77-217e-4952-81f3-316b9e584b22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047864 Aug 29 22:54:15.253964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 920/1843] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:15.547816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1ad766fd-caf6-49e9-8445-bef47bb32b4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:15.549944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1ad766fd-caf6-49e9-8445-bef47bb32b4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:15.556991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad766fd-caf6-49e9-8445-bef47bb32b4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.557486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad766fd-caf6-49e9-8445-bef47bb32b4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.557934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad766fd-caf6-49e9-8445-bef47bb32b4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.558662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad766fd-caf6-49e9-8445-bef47bb32b4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.559121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad766fd-caf6-49e9-8445-bef47bb32b4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.559552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ad766fd-caf6-49e9-8445-bef47bb32b4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.599329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1ad766fd-caf6-49e9-8445-bef47bb32b4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055883 Aug 29 22:54:15.599998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 924/1844] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:16.103397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:16.104614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:16.113175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-14859f60-1697-4945-9ff9-5217a0c0552b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:16.115380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-14859f60-1697-4945-9ff9-5217a0c0552b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:16.116995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.117894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.118690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.119962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.120838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.121460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14859f60-1697-4945-9ff9-5217a0c0552b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.121601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.121950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14859f60-1697-4945-9ff9-5217a0c0552b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.122407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14859f60-1697-4945-9ff9-5217a0c0552b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.123097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14859f60-1697-4945-9ff9-5217a0c0552b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.123553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14859f60-1697-4945-9ff9-5217a0c0552b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.123977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14859f60-1697-4945-9ff9-5217a0c0552b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.127538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:16.157740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-14859f60-1697-4945-9ff9-5217a0c0552b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049247 Aug 29 22:54:16.158336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 925/1845] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:54:16.205459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:16.213660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5ae0d5ff-4553-4491-8a59-5c3c392d183a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.117681 Aug 29 22:54:16.214264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 921/1846] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:16 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:16.267994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7b2a6cb3-c01f-440c-8968-cb664c7b8084 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:16.270255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7b2a6cb3-c01f-440c-8968-cb664c7b8084 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:16.276604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b2a6cb3-c01f-440c-8968-cb664c7b8084 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.277082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b2a6cb3-c01f-440c-8968-cb664c7b8084 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.277519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b2a6cb3-c01f-440c-8968-cb664c7b8084 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.278211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b2a6cb3-c01f-440c-8968-cb664c7b8084 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.278751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b2a6cb3-c01f-440c-8968-cb664c7b8084 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.279172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b2a6cb3-c01f-440c-8968-cb664c7b8084 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.342550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7b2a6cb3-c01f-440c-8968-cb664c7b8084 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079246 Aug 29 22:54:16.343140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 926/1847] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:16.612406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9f12b37c-72e5-49a8-b4a7-49c649a0e916 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:16.614608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9f12b37c-72e5-49a8-b4a7-49c649a0e916 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:16.616524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:16.621250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f12b37c-72e5-49a8-b4a7-49c649a0e916 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.621729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f12b37c-72e5-49a8-b4a7-49c649a0e916 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.622165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f12b37c-72e5-49a8-b4a7-49c649a0e916 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.622864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f12b37c-72e5-49a8-b4a7-49c649a0e916 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.623314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f12b37c-72e5-49a8-b4a7-49c649a0e916 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.623738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f12b37c-72e5-49a8-b4a7-49c649a0e916 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.655683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9f12b37c-72e5-49a8-b4a7-49c649a0e916 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047382 Aug 29 22:54:16.656346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 922/1848] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:17.170173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-699b185d-a79d-44ef-b580-95589510062f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:17.172565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-699b185d-a79d-44ef-b580-95589510062f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:17.179299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699b185d-a79d-44ef-b580-95589510062f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.179695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699b185d-a79d-44ef-b580-95589510062f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.180120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699b185d-a79d-44ef-b580-95589510062f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.180834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699b185d-a79d-44ef-b580-95589510062f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.181276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699b185d-a79d-44ef-b580-95589510062f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.181690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-699b185d-a79d-44ef-b580-95589510062f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.213865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-699b185d-a79d-44ef-b580-95589510062f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047633 Aug 29 22:54:17.214435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 927/1849] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:17.235348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:17.236249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:17.243062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.243534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.243966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.244681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.245127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.245544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.312803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:17.321792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b654cfcd-b088-491f-ba2f-8f884994367a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090630 Aug 29 22:54:17.325460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 923/1850] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:17 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:17.355202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-98c0959b-7ffc-4dc9-9b8b-0df0423c9670 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:17.357355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-98c0959b-7ffc-4dc9-9b8b-0df0423c9670 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:17.364190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98c0959b-7ffc-4dc9-9b8b-0df0423c9670 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.364698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98c0959b-7ffc-4dc9-9b8b-0df0423c9670 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.365144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98c0959b-7ffc-4dc9-9b8b-0df0423c9670 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.365838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98c0959b-7ffc-4dc9-9b8b-0df0423c9670 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.366287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98c0959b-7ffc-4dc9-9b8b-0df0423c9670 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.366738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98c0959b-7ffc-4dc9-9b8b-0df0423c9670 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.399113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-98c0959b-7ffc-4dc9-9b8b-0df0423c9670 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047733 Aug 29 22:54:17.399685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 928/1851] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:17.669901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d268d4a6-7d19-4414-81e5-6d5fd766dbaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:17.672920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d268d4a6-7d19-4414-81e5-6d5fd766dbaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:17.679024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d268d4a6-7d19-4414-81e5-6d5fd766dbaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.679508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d268d4a6-7d19-4414-81e5-6d5fd766dbaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.679946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d268d4a6-7d19-4414-81e5-6d5fd766dbaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.680682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d268d4a6-7d19-4414-81e5-6d5fd766dbaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.681136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d268d4a6-7d19-4414-81e5-6d5fd766dbaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.681561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d268d4a6-7d19-4414-81e5-6d5fd766dbaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.713341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d268d4a6-7d19-4414-81e5-6d5fd766dbaf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047423 Aug 29 22:54:17.713921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 924/1852] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:18.227713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fc89127b-1066-4612-97e7-e365b89f9f12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:18.229844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fc89127b-1066-4612-97e7-e365b89f9f12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:18.236532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc89127b-1066-4612-97e7-e365b89f9f12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.237027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc89127b-1066-4612-97e7-e365b89f9f12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.237567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc89127b-1066-4612-97e7-e365b89f9f12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.238291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc89127b-1066-4612-97e7-e365b89f9f12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.238749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc89127b-1066-4612-97e7-e365b89f9f12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.239175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc89127b-1066-4612-97e7-e365b89f9f12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.272074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fc89127b-1066-4612-97e7-e365b89f9f12 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048509 Aug 29 22:54:18.272725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 929/1853] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:18.344527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:18.345139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:18.351677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.352176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.352612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.353313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.353768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.354191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.412547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-31627797-3559-4c06-b94e-c39ec02aabde tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:18.414808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-31627797-3559-4c06-b94e-c39ec02aabde tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:18.419046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:18.421024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31627797-3559-4c06-b94e-c39ec02aabde tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.422089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31627797-3559-4c06-b94e-c39ec02aabde tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.422859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31627797-3559-4c06-b94e-c39ec02aabde tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.423690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31627797-3559-4c06-b94e-c39ec02aabde tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.424164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31627797-3559-4c06-b94e-c39ec02aabde tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.424597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31627797-3559-4c06-b94e-c39ec02aabde tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.428132 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-120a0a72-c2de-4db3-b460-4eb7a3c0b25a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087496 Aug 29 22:54:18.428775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 925/1854] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:18 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:18.457859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-31627797-3559-4c06-b94e-c39ec02aabde tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049935 Aug 29 22:54:18.458433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 930/1855] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:18.725703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c5633f1b-b7c6-4b89-884a-bf73a9a0fc40 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:18.727871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c5633f1b-b7c6-4b89-884a-bf73a9a0fc40 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:18.734656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5633f1b-b7c6-4b89-884a-bf73a9a0fc40 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.735240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5633f1b-b7c6-4b89-884a-bf73a9a0fc40 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.735739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5633f1b-b7c6-4b89-884a-bf73a9a0fc40 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.736700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5633f1b-b7c6-4b89-884a-bf73a9a0fc40 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.737182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5633f1b-b7c6-4b89-884a-bf73a9a0fc40 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.737649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5633f1b-b7c6-4b89-884a-bf73a9a0fc40 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.772253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c5633f1b-b7c6-4b89-884a-bf73a9a0fc40 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050468 Aug 29 22:54:18.772902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 926/1856] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:19.285251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3eaf4da9-ce37-42b6-ba47-8d6248b88ed4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:19.287465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3eaf4da9-ce37-42b6-ba47-8d6248b88ed4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:19.294307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eaf4da9-ce37-42b6-ba47-8d6248b88ed4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.294785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eaf4da9-ce37-42b6-ba47-8d6248b88ed4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.295215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eaf4da9-ce37-42b6-ba47-8d6248b88ed4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.295914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eaf4da9-ce37-42b6-ba47-8d6248b88ed4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.296919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eaf4da9-ce37-42b6-ba47-8d6248b88ed4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.297337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eaf4da9-ce37-42b6-ba47-8d6248b88ed4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.328344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3eaf4da9-ce37-42b6-ba47-8d6248b88ed4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046671 Aug 29 22:54:19.328926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 931/1857] 10.222.0.59 () {60 vars in 1343 bytes} [Mon Aug 29 22:54:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:54:19.449448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:19.450086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:19.457698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.458188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.458623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.459327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.459779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.460249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.471369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4e3b1c7d-7bb0-4a9d-8e60-3e279ad44302 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:19.473754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4e3b1c7d-7bb0-4a9d-8e60-3e279ad44302 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:19.479839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e3b1c7d-7bb0-4a9d-8e60-3e279ad44302 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.480344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e3b1c7d-7bb0-4a9d-8e60-3e279ad44302 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.480779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e3b1c7d-7bb0-4a9d-8e60-3e279ad44302 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.481472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e3b1c7d-7bb0-4a9d-8e60-3e279ad44302 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.481953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e3b1c7d-7bb0-4a9d-8e60-3e279ad44302 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.482377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e3b1c7d-7bb0-4a9d-8e60-3e279ad44302 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.500287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:19.514459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4e3b1c7d-7bb0-4a9d-8e60-3e279ad44302 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047571 Aug 29 22:54:19.520630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 932/1858] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:19.524333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:19.533082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-567fb89e-c383-4cb9-9e91-42068f888bef tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087508 Aug 29 22:54:19.533653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 927/1859] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:19 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:19.784454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-818d35c9-cd57-421c-8faf-3a58f8f20701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:19.786581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-818d35c9-cd57-421c-8faf-3a58f8f20701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:19.793292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-818d35c9-cd57-421c-8faf-3a58f8f20701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.793774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-818d35c9-cd57-421c-8faf-3a58f8f20701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.794211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-818d35c9-cd57-421c-8faf-3a58f8f20701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.794907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-818d35c9-cd57-421c-8faf-3a58f8f20701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.795360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-818d35c9-cd57-421c-8faf-3a58f8f20701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.795788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-818d35c9-cd57-421c-8faf-3a58f8f20701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.826105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-818d35c9-cd57-421c-8faf-3a58f8f20701 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045624 Aug 29 22:54:19.826669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 933/1860] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:20.340862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6b6ac6d7-232b-4339-8725-01439200b6fa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:20.343049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6b6ac6d7-232b-4339-8725-01439200b6fa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:20.349671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6ac6d7-232b-4339-8725-01439200b6fa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.350146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6ac6d7-232b-4339-8725-01439200b6fa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.350579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6ac6d7-232b-4339-8725-01439200b6fa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.351296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6ac6d7-232b-4339-8725-01439200b6fa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.351744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6ac6d7-232b-4339-8725-01439200b6fa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.352197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6ac6d7-232b-4339-8725-01439200b6fa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.438547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6b6ac6d7-232b-4339-8725-01439200b6fa tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "POST /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/action" status: 200 len: 37818 microversion: 2.20 time: 0.101368 Aug 29 22:54:20.439693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 928/1861] 10.222.0.59 () {62 vars in 1319 bytes} [Mon Aug 29 22:54:20 2022] POST /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0/action => generated 37818 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:54:20.531799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7f1882d0-a883-494e-a224-50d50daf15c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:20.534123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7f1882d0-a883-494e-a224-50d50daf15c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:20.540562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f1882d0-a883-494e-a224-50d50daf15c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.541040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f1882d0-a883-494e-a224-50d50daf15c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.541475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f1882d0-a883-494e-a224-50d50daf15c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.542165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f1882d0-a883-494e-a224-50d50daf15c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.542649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f1882d0-a883-494e-a224-50d50daf15c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.543064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f1882d0-a883-494e-a224-50d50daf15c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.554663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:20.555390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:20.563854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.564463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.564903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.565613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.566072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.566498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.580729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7f1882d0-a883-494e-a224-50d50daf15c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053506 Aug 29 22:54:20.581324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 934/1862] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:20.634382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:20.642242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f3de441d-8f0e-4726-bbbf-dbcee12e7175 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091978 Aug 29 22:54:20.642802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 929/1863] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:20 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:20.839109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4812c490-99e4-4c12-84f6-bf55536f4698 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:20.841311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4812c490-99e4-4c12-84f6-bf55536f4698 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:20.848422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4812c490-99e4-4c12-84f6-bf55536f4698 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.848910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4812c490-99e4-4c12-84f6-bf55536f4698 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.849352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4812c490-99e4-4c12-84f6-bf55536f4698 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.850047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4812c490-99e4-4c12-84f6-bf55536f4698 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.850502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4812c490-99e4-4c12-84f6-bf55536f4698 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.850926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4812c490-99e4-4c12-84f6-bf55536f4698 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.880587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4812c490-99e4-4c12-84f6-bf55536f4698 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045411 Aug 29 22:54:20.881153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 935/1864] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:21.593970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d590df0d-54a2-48be-8ea6-d4309ffa4e26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:21.596225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d590df0d-54a2-48be-8ea6-d4309ffa4e26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:21.602758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d590df0d-54a2-48be-8ea6-d4309ffa4e26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.603232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d590df0d-54a2-48be-8ea6-d4309ffa4e26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.603662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d590df0d-54a2-48be-8ea6-d4309ffa4e26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.604386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d590df0d-54a2-48be-8ea6-d4309ffa4e26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.604834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d590df0d-54a2-48be-8ea6-d4309ffa4e26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.605251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d590df0d-54a2-48be-8ea6-d4309ffa4e26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.635324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d590df0d-54a2-48be-8ea6-d4309ffa4e26 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Aug 29 22:54:21.635878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 930/1865] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:21 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:21.663134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:21.663798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:21.670696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.671517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.672100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.672879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.673388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.679846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.791121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:21.799497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6c51487d-202b-4d71-9729-5ae4d57b7bd0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.140265 Aug 29 22:54:21.800106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 936/1866] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:21 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:21.892991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e2cf2760-af7b-47e7-b99e-41f1350e4a76 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:21.895156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e2cf2760-af7b-47e7-b99e-41f1350e4a76 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:21.901656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2cf2760-af7b-47e7-b99e-41f1350e4a76 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.902134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2cf2760-af7b-47e7-b99e-41f1350e4a76 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.902575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2cf2760-af7b-47e7-b99e-41f1350e4a76 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.903267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2cf2760-af7b-47e7-b99e-41f1350e4a76 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.903722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2cf2760-af7b-47e7-b99e-41f1350e4a76 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.904159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e2cf2760-af7b-47e7-b99e-41f1350e4a76 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.935208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e2cf2760-af7b-47e7-b99e-41f1350e4a76 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047077 Aug 29 22:54:21.935769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 931/1867] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:22.647788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c104b54b-28aa-4231-a380-7b3808914e4b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:22.649951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c104b54b-28aa-4231-a380-7b3808914e4b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:22.656500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c104b54b-28aa-4231-a380-7b3808914e4b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:22.657085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c104b54b-28aa-4231-a380-7b3808914e4b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:22.657519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c104b54b-28aa-4231-a380-7b3808914e4b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:22.658211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c104b54b-28aa-4231-a380-7b3808914e4b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:22.658666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c104b54b-28aa-4231-a380-7b3808914e4b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:22.659094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c104b54b-28aa-4231-a380-7b3808914e4b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:22.689986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c104b54b-28aa-4231-a380-7b3808914e4b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Aug 29 22:54:22.690697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 937/1868] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:22.820715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:22.821534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:22.828578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:22.829278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:22.829719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:22.830444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:22.830909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:22.831342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:22.902229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:22.910679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7bd1cbf7-5e8f-445e-8f2c-8d999794928c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093868 Aug 29 22:54:22.913185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 932/1869] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:22 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:22.948816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-38928ef3-dac0-4d6b-bebf-872a3ae69d5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:22.951021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-38928ef3-dac0-4d6b-bebf-872a3ae69d5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:22.958817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38928ef3-dac0-4d6b-bebf-872a3ae69d5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:22.959302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38928ef3-dac0-4d6b-bebf-872a3ae69d5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:22.959742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38928ef3-dac0-4d6b-bebf-872a3ae69d5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:22.960471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38928ef3-dac0-4d6b-bebf-872a3ae69d5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:22.960951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38928ef3-dac0-4d6b-bebf-872a3ae69d5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:22.961378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38928ef3-dac0-4d6b-bebf-872a3ae69d5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:22.994777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-38928ef3-dac0-4d6b-bebf-872a3ae69d5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049950 Aug 29 22:54:22.995370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 938/1870] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:23.701884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-66e3835a-01f4-48bc-91c3-3f12df04c1ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:23.704881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-66e3835a-01f4-48bc-91c3-3f12df04c1ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:23.711492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66e3835a-01f4-48bc-91c3-3f12df04c1ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:23.711966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66e3835a-01f4-48bc-91c3-3f12df04c1ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:23.712427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66e3835a-01f4-48bc-91c3-3f12df04c1ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:23.713121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66e3835a-01f4-48bc-91c3-3f12df04c1ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:23.713573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66e3835a-01f4-48bc-91c3-3f12df04c1ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:23.713992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-66e3835a-01f4-48bc-91c3-3f12df04c1ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:23.744675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-66e3835a-01f4-48bc-91c3-3f12df04c1ca tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046593 Aug 29 22:54:23.745244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 933/1871] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:23.941082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:23.941705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:23.943689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:54:23.943850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 22:54:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 (ip 10.222.0.59) !!! Aug 29 22:54:23.956052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:23.956799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:23.957230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:23.957923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:23.958370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:23.958788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:24.007043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4e389eb6-3578-4b07-b365-6a4f10c29af8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:24.009410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4e389eb6-3578-4b07-b365-6a4f10c29af8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:24.016019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e389eb6-3578-4b07-b365-6a4f10c29af8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:24.016670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e389eb6-3578-4b07-b365-6a4f10c29af8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:24.017109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e389eb6-3578-4b07-b365-6a4f10c29af8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:24.017811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e389eb6-3578-4b07-b365-6a4f10c29af8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:24.018260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e389eb6-3578-4b07-b365-6a4f10c29af8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:24.018680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e389eb6-3578-4b07-b365-6a4f10c29af8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:24.022184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:24.030084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c0bc21ed-2269-4da9-bd1b-acfd951f5326 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093030 Aug 29 22:54:24.031325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 939/1872] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:23 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:24.050290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4e389eb6-3578-4b07-b365-6a4f10c29af8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047173 Aug 29 22:54:24.050856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 934/1873] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:24.757120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4c20c6b9-e45b-464d-b04b-155220de2fd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:24.759285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4c20c6b9-e45b-464d-b04b-155220de2fd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:24.765445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c20c6b9-e45b-464d-b04b-155220de2fd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:24.765932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c20c6b9-e45b-464d-b04b-155220de2fd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:24.766365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c20c6b9-e45b-464d-b04b-155220de2fd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:24.767064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c20c6b9-e45b-464d-b04b-155220de2fd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:24.767512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c20c6b9-e45b-464d-b04b-155220de2fd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:24.767931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c20c6b9-e45b-464d-b04b-155220de2fd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:24.799329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4c20c6b9-e45b-464d-b04b-155220de2fd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Aug 29 22:54:24.799910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 940/1874] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:25.052952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:25.053520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:25.060449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.060942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.061384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.062092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.062554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.062713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e696c29e-df5f-4c9e-bc76-516b3134e00a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:25.063131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.064785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e696c29e-df5f-4c9e-bc76-516b3134e00a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:25.071110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e696c29e-df5f-4c9e-bc76-516b3134e00a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.071585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e696c29e-df5f-4c9e-bc76-516b3134e00a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.072046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e696c29e-df5f-4c9e-bc76-516b3134e00a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.072765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e696c29e-df5f-4c9e-bc76-516b3134e00a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.073211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e696c29e-df5f-4c9e-bc76-516b3134e00a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.073625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e696c29e-df5f-4c9e-bc76-516b3134e00a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.104753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e696c29e-df5f-4c9e-bc76-516b3134e00a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046172 Aug 29 22:54:25.105325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 941/1875] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:25.126099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:25.133820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7ee7a008-af6b-4035-951f-9b8d3ab99f4c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084785 Aug 29 22:54:25.134385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 935/1876] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:25.812559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c7cb575c-9260-41c6-9197-9712a266de3e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:25.814698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c7cb575c-9260-41c6-9197-9712a266de3e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:25.820686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7cb575c-9260-41c6-9197-9712a266de3e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.821165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7cb575c-9260-41c6-9197-9712a266de3e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.821595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7cb575c-9260-41c6-9197-9712a266de3e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.822281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7cb575c-9260-41c6-9197-9712a266de3e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.822757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7cb575c-9260-41c6-9197-9712a266de3e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.823174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7cb575c-9260-41c6-9197-9712a266de3e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.853422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c7cb575c-9260-41c6-9197-9712a266de3e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Aug 29 22:54:25.854023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 942/1877] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:26.117280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cb7449b0-4fad-4299-9ae3-4439342ce9aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:26.119377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cb7449b0-4fad-4299-9ae3-4439342ce9aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:26.125963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb7449b0-4fad-4299-9ae3-4439342ce9aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:26.126452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb7449b0-4fad-4299-9ae3-4439342ce9aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:26.126920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb7449b0-4fad-4299-9ae3-4439342ce9aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:26.127599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb7449b0-4fad-4299-9ae3-4439342ce9aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:26.128055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb7449b0-4fad-4299-9ae3-4439342ce9aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:26.128518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb7449b0-4fad-4299-9ae3-4439342ce9aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:26.154977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:26.156224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:26.158981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cb7449b0-4fad-4299-9ae3-4439342ce9aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Aug 29 22:54:26.159564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 936/1878] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:26.162790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:26.163275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:26.163711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:26.164440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:26.164895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:26.165321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:26.226967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:26.235513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f6a3f3ba-c7ed-4d5c-85b1-ab3d006fbf84 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084373 Aug 29 22:54:26.236091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 943/1879] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:26.865885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-14057b04-09f9-4834-a892-3e257771352f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:26.868161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-14057b04-09f9-4834-a892-3e257771352f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:26.875046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14057b04-09f9-4834-a892-3e257771352f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:26.875617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14057b04-09f9-4834-a892-3e257771352f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:26.876051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14057b04-09f9-4834-a892-3e257771352f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:26.877174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14057b04-09f9-4834-a892-3e257771352f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:26.877293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14057b04-09f9-4834-a892-3e257771352f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:26.877687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14057b04-09f9-4834-a892-3e257771352f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:26.909169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-14057b04-09f9-4834-a892-3e257771352f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Aug 29 22:54:26.909739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 937/1880] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:27.171964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fdd7de43-a18a-48fa-850b-12f714069ee3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:27.174180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fdd7de43-a18a-48fa-850b-12f714069ee3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:27.180686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdd7de43-a18a-48fa-850b-12f714069ee3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.181161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdd7de43-a18a-48fa-850b-12f714069ee3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.181588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdd7de43-a18a-48fa-850b-12f714069ee3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.182287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdd7de43-a18a-48fa-850b-12f714069ee3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.182898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdd7de43-a18a-48fa-850b-12f714069ee3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.183465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fdd7de43-a18a-48fa-850b-12f714069ee3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.214004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fdd7de43-a18a-48fa-850b-12f714069ee3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Aug 29 22:54:27.214562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 944/1881] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:27.256883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:27.257482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:27.264004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.264510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.264940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.265625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.266072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.266490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.269314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:27.333355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:27.341407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2470c43b-e37a-4a6c-b7bb-b50551646b99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088425 Aug 29 22:54:27.347114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 938/1882] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:27 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:27.921920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-375aaa1e-f327-46dd-a36a-df5ca20fae01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:27.924158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-375aaa1e-f327-46dd-a36a-df5ca20fae01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:27.930153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-375aaa1e-f327-46dd-a36a-df5ca20fae01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.930692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-375aaa1e-f327-46dd-a36a-df5ca20fae01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.931046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-375aaa1e-f327-46dd-a36a-df5ca20fae01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.931731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-375aaa1e-f327-46dd-a36a-df5ca20fae01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.932197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-375aaa1e-f327-46dd-a36a-df5ca20fae01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.932614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-375aaa1e-f327-46dd-a36a-df5ca20fae01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.962864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-375aaa1e-f327-46dd-a36a-df5ca20fae01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Aug 29 22:54:27.963412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 945/1883] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:27 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:28.226928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f6c4d747-0aae-408f-a0cd-35b63516306b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:28.229021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f6c4d747-0aae-408f-a0cd-35b63516306b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:28.235720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c4d747-0aae-408f-a0cd-35b63516306b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:28.236286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c4d747-0aae-408f-a0cd-35b63516306b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:28.236743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c4d747-0aae-408f-a0cd-35b63516306b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:28.237374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c4d747-0aae-408f-a0cd-35b63516306b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:28.237827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c4d747-0aae-408f-a0cd-35b63516306b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:28.238249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c4d747-0aae-408f-a0cd-35b63516306b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:28.267597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f6c4d747-0aae-408f-a0cd-35b63516306b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044655 Aug 29 22:54:28.268495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 939/1884] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:28.362828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:28.363496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:28.370110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:28.370593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:28.371027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:28.371725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:28.372336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:28.372652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:28.439179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:28.447166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f1ad617a-f32d-43fc-af0e-52ee2576bac5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088897 Aug 29 22:54:28.447760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 946/1885] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:28 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:28.976346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fa3ee68e-a958-4f81-8703-5c810b2aa658 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:28.978579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fa3ee68e-a958-4f81-8703-5c810b2aa658 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:28.985972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa3ee68e-a958-4f81-8703-5c810b2aa658 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:28.986454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa3ee68e-a958-4f81-8703-5c810b2aa658 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:28.986891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa3ee68e-a958-4f81-8703-5c810b2aa658 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:28.987588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa3ee68e-a958-4f81-8703-5c810b2aa658 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:28.988038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa3ee68e-a958-4f81-8703-5c810b2aa658 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:28.988489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fa3ee68e-a958-4f81-8703-5c810b2aa658 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:29.018693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fa3ee68e-a958-4f81-8703-5c810b2aa658 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046454 Aug 29 22:54:29.019476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 940/1886] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:29.279715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a1376a79-cab9-413e-9853-72a213084ec8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:29.282330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a1376a79-cab9-413e-9853-72a213084ec8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:29.288448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1376a79-cab9-413e-9853-72a213084ec8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:29.288931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1376a79-cab9-413e-9853-72a213084ec8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:29.289367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1376a79-cab9-413e-9853-72a213084ec8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:29.290065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1376a79-cab9-413e-9853-72a213084ec8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:29.290514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1376a79-cab9-413e-9853-72a213084ec8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:29.290934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a1376a79-cab9-413e-9853-72a213084ec8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:29.322472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a1376a79-cab9-413e-9853-72a213084ec8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046866 Aug 29 22:54:29.323030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 947/1887] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:29.468778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:29.469804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:29.476450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:29.476939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:29.477375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:29.478071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:29.478525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:29.478981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:29.544659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:29.552915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cd3add94-60de-4e37-beb9-e32a62a92955 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088838 Aug 29 22:54:29.553484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 941/1888] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:29 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:30.031306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2e54567b-a9fc-4db4-9009-a607f95ad21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:30.033464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2e54567b-a9fc-4db4-9009-a607f95ad21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:30.040185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e54567b-a9fc-4db4-9009-a607f95ad21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.040660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e54567b-a9fc-4db4-9009-a607f95ad21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.041085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e54567b-a9fc-4db4-9009-a607f95ad21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.041790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e54567b-a9fc-4db4-9009-a607f95ad21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.042314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e54567b-a9fc-4db4-9009-a607f95ad21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.042649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e54567b-a9fc-4db4-9009-a607f95ad21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.073198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2e54567b-a9fc-4db4-9009-a607f95ad21b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Aug 29 22:54:30.073756 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 948/1889] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:30.335121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8c1b0677-f038-43e7-bb5c-a8ba6bbce77f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:30.337237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8c1b0677-f038-43e7-bb5c-a8ba6bbce77f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:30.343203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c1b0677-f038-43e7-bb5c-a8ba6bbce77f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.343686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c1b0677-f038-43e7-bb5c-a8ba6bbce77f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.344108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c1b0677-f038-43e7-bb5c-a8ba6bbce77f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.344810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c1b0677-f038-43e7-bb5c-a8ba6bbce77f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.345263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c1b0677-f038-43e7-bb5c-a8ba6bbce77f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.345673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c1b0677-f038-43e7-bb5c-a8ba6bbce77f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.375986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8c1b0677-f038-43e7-bb5c-a8ba6bbce77f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044890 Aug 29 22:54:30.376577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 942/1890] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:30.573662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:30.574265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:30.580806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.581279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.581704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.582386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.582828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.583242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.587328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:30.647178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:30.654913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3351ab00-5b41-4a58-be30-ed43fcc98374 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085086 Aug 29 22:54:30.655973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 949/1891] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:30 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:31.086182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-32b08c23-e7d0-4800-9e46-1cf81c244917 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:31.088364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-32b08c23-e7d0-4800-9e46-1cf81c244917 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:31.095497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32b08c23-e7d0-4800-9e46-1cf81c244917 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.095991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32b08c23-e7d0-4800-9e46-1cf81c244917 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.096439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32b08c23-e7d0-4800-9e46-1cf81c244917 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.097130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32b08c23-e7d0-4800-9e46-1cf81c244917 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.097583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32b08c23-e7d0-4800-9e46-1cf81c244917 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.098008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32b08c23-e7d0-4800-9e46-1cf81c244917 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.127790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-32b08c23-e7d0-4800-9e46-1cf81c244917 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046185 Aug 29 22:54:31.131142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 943/1892] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:31.388580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b4d02cb7-2c14-4043-ad97-1cdace42c718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:31.391364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b4d02cb7-2c14-4043-ad97-1cdace42c718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:31.397951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4d02cb7-2c14-4043-ad97-1cdace42c718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.398425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4d02cb7-2c14-4043-ad97-1cdace42c718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.398854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4d02cb7-2c14-4043-ad97-1cdace42c718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.399539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4d02cb7-2c14-4043-ad97-1cdace42c718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.399983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4d02cb7-2c14-4043-ad97-1cdace42c718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.400429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b4d02cb7-2c14-4043-ad97-1cdace42c718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.430529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b4d02cb7-2c14-4043-ad97-1cdace42c718 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045989 Aug 29 22:54:31.431101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 950/1893] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:31.676829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:31.677559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:31.683563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.684045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.684511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.685199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.685651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.686074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.751701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:31.759552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dda89e05-30e9-42a4-b624-1635870b6a12 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086576 Aug 29 22:54:31.760128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 944/1894] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:31 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:32.140486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-34b174f1-d9cf-450d-8d80-3e6804706699 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:32.142599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-34b174f1-d9cf-450d-8d80-3e6804706699 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:32.148770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34b174f1-d9cf-450d-8d80-3e6804706699 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.149255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34b174f1-d9cf-450d-8d80-3e6804706699 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.149695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34b174f1-d9cf-450d-8d80-3e6804706699 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.150397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34b174f1-d9cf-450d-8d80-3e6804706699 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.150848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34b174f1-d9cf-450d-8d80-3e6804706699 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.151271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34b174f1-d9cf-450d-8d80-3e6804706699 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.181998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-34b174f1-d9cf-450d-8d80-3e6804706699 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045625 Aug 29 22:54:32.182494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 951/1895] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:32.443277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b85458b5-c821-4349-80f2-32db78122c96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:32.445426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b85458b5-c821-4349-80f2-32db78122c96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:32.451819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85458b5-c821-4349-80f2-32db78122c96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.453319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85458b5-c821-4349-80f2-32db78122c96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.453761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85458b5-c821-4349-80f2-32db78122c96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.454456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85458b5-c821-4349-80f2-32db78122c96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.454926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85458b5-c821-4349-80f2-32db78122c96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.455330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85458b5-c821-4349-80f2-32db78122c96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.485667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b85458b5-c821-4349-80f2-32db78122c96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046613 Aug 29 22:54:32.486227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 945/1896] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:32.780593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:32.781138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:32.787754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.788263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.788698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.789377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.789820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.790238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.852460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:32.860641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c35ec512-2833-4e6a-ac7c-1d86ffc3da6e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.083986 Aug 29 22:54:32.861213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 952/1897] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:32 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:33.194980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b551d9aa-8f4f-41c5-9ed5-d124bf3d115f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:33.197261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b551d9aa-8f4f-41c5-9ed5-d124bf3d115f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:33.203777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b551d9aa-8f4f-41c5-9ed5-d124bf3d115f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.204283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b551d9aa-8f4f-41c5-9ed5-d124bf3d115f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.204717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b551d9aa-8f4f-41c5-9ed5-d124bf3d115f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.205405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b551d9aa-8f4f-41c5-9ed5-d124bf3d115f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.205850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b551d9aa-8f4f-41c5-9ed5-d124bf3d115f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.206271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b551d9aa-8f4f-41c5-9ed5-d124bf3d115f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.237067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b551d9aa-8f4f-41c5-9ed5-d124bf3d115f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046111 Aug 29 22:54:33.237627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 946/1898] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:33.498432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5558a4d7-2831-4cc9-9dc7-3932ff3a0fda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:33.501214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5558a4d7-2831-4cc9-9dc7-3932ff3a0fda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:33.507763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5558a4d7-2831-4cc9-9dc7-3932ff3a0fda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.508288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5558a4d7-2831-4cc9-9dc7-3932ff3a0fda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.508737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5558a4d7-2831-4cc9-9dc7-3932ff3a0fda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.509439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5558a4d7-2831-4cc9-9dc7-3932ff3a0fda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.509899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5558a4d7-2831-4cc9-9dc7-3932ff3a0fda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.510414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5558a4d7-2831-4cc9-9dc7-3932ff3a0fda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.540758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5558a4d7-2831-4cc9-9dc7-3932ff3a0fda tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046325 Aug 29 22:54:33.541322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 953/1899] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:33.881646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:33.882875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:33.890828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.891307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.891738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.892470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.893029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.893375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.958078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:33.965918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c0edb68f-a810-4b8a-b35b-928554536232 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088103 Aug 29 22:54:33.966648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 947/1900] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:33 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:34.250516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ad08f28b-bbe6-43d2-ae70-f8708ecf811e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:34.252601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ad08f28b-bbe6-43d2-ae70-f8708ecf811e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:34.259365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad08f28b-bbe6-43d2-ae70-f8708ecf811e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.259835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad08f28b-bbe6-43d2-ae70-f8708ecf811e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.260298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad08f28b-bbe6-43d2-ae70-f8708ecf811e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.260979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad08f28b-bbe6-43d2-ae70-f8708ecf811e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.261427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad08f28b-bbe6-43d2-ae70-f8708ecf811e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.261838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad08f28b-bbe6-43d2-ae70-f8708ecf811e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.291730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ad08f28b-bbe6-43d2-ae70-f8708ecf811e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046008 Aug 29 22:54:34.292317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 954/1901] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:34.553315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6fa13104-eeed-48b6-bd0b-997a04bbacdb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:34.555393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6fa13104-eeed-48b6-bd0b-997a04bbacdb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:34.562092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fa13104-eeed-48b6-bd0b-997a04bbacdb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.562687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fa13104-eeed-48b6-bd0b-997a04bbacdb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.563155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fa13104-eeed-48b6-bd0b-997a04bbacdb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.563839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fa13104-eeed-48b6-bd0b-997a04bbacdb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.564321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fa13104-eeed-48b6-bd0b-997a04bbacdb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.564750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fa13104-eeed-48b6-bd0b-997a04bbacdb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.594428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6fa13104-eeed-48b6-bd0b-997a04bbacdb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045124 Aug 29 22:54:34.595000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 948/1902] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:34.988242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:34.988825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:34.994758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.995237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.995684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.996543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.997000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.997453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.059142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:35.067344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-03bc13d4-3b4d-4447-978d-acefc0e11523 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.083996 Aug 29 22:54:35.067912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 955/1903] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:34 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:35.304113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2e60203d-271e-4909-8327-8960585f2add tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:35.306203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2e60203d-271e-4909-8327-8960585f2add tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:35.312755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e60203d-271e-4909-8327-8960585f2add tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.313234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e60203d-271e-4909-8327-8960585f2add tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.313653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e60203d-271e-4909-8327-8960585f2add tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.314336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e60203d-271e-4909-8327-8960585f2add tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.314778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e60203d-271e-4909-8327-8960585f2add tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.315194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e60203d-271e-4909-8327-8960585f2add tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.346724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2e60203d-271e-4909-8327-8960585f2add tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 Aug 29 22:54:35.347297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 949/1904] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:35.606866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-02751328-a346-420c-8deb-e62872b1f293 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:35.609081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-02751328-a346-420c-8deb-e62872b1f293 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:35.615574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02751328-a346-420c-8deb-e62872b1f293 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.616060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02751328-a346-420c-8deb-e62872b1f293 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.616536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02751328-a346-420c-8deb-e62872b1f293 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.617233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02751328-a346-420c-8deb-e62872b1f293 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.617688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02751328-a346-420c-8deb-e62872b1f293 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.618120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02751328-a346-420c-8deb-e62872b1f293 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.648504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-02751328-a346-420c-8deb-e62872b1f293 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Aug 29 22:54:35.649065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 956/1905] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:36.089097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:36.089708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:36.095684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.096205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.096651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.097345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.097807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.098233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.159521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:36.167464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-abf114be-f852-40d4-ba0d-040dc72359bc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.082264 Aug 29 22:54:36.168049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 950/1906] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:36 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:36.360450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-af5bd741-950d-40bf-90ef-42b200beff0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:36.362608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-af5bd741-950d-40bf-90ef-42b200beff0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:36.368852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af5bd741-950d-40bf-90ef-42b200beff0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.369330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af5bd741-950d-40bf-90ef-42b200beff0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.370160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af5bd741-950d-40bf-90ef-42b200beff0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.370458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af5bd741-950d-40bf-90ef-42b200beff0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.370907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af5bd741-950d-40bf-90ef-42b200beff0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.371330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af5bd741-950d-40bf-90ef-42b200beff0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.403664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-af5bd741-950d-40bf-90ef-42b200beff0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047915 Aug 29 22:54:36.404244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 957/1907] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:36.661583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-754e501b-843c-4a9a-892c-ccfeb911e1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:36.663735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-754e501b-843c-4a9a-892c-ccfeb911e1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:36.670088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-754e501b-843c-4a9a-892c-ccfeb911e1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.670564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-754e501b-843c-4a9a-892c-ccfeb911e1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.671027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-754e501b-843c-4a9a-892c-ccfeb911e1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.671808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-754e501b-843c-4a9a-892c-ccfeb911e1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.672279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-754e501b-843c-4a9a-892c-ccfeb911e1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.672710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-754e501b-843c-4a9a-892c-ccfeb911e1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.704458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-754e501b-843c-4a9a-892c-ccfeb911e1e7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046847 Aug 29 22:54:36.705043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 951/1908] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:37.190679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:37.191262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:37.197993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:37.198473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:37.198906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.199598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:37.200045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:37.200508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.266516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:37.274451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-96ed20e9-c893-4c26-b370-840e07aa6bfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089067 Aug 29 22:54:37.275038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 958/1909] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:37 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:37.416709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e31e27a3-5a83-4431-b971-2591bc82c56d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:37.422134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e31e27a3-5a83-4431-b971-2591bc82c56d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:37.425495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e31e27a3-5a83-4431-b971-2591bc82c56d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:37.425984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e31e27a3-5a83-4431-b971-2591bc82c56d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:37.426425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e31e27a3-5a83-4431-b971-2591bc82c56d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.427127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e31e27a3-5a83-4431-b971-2591bc82c56d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:37.427604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e31e27a3-5a83-4431-b971-2591bc82c56d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:37.428024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e31e27a3-5a83-4431-b971-2591bc82c56d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.460673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e31e27a3-5a83-4431-b971-2591bc82c56d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047888 Aug 29 22:54:37.461148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 952/1910] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:37.716958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3d0e7955-dbdb-4240-8e79-f958c26a854e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:37.719058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3d0e7955-dbdb-4240-8e79-f958c26a854e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:37.725046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0e7955-dbdb-4240-8e79-f958c26a854e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:37.725515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0e7955-dbdb-4240-8e79-f958c26a854e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:37.725943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0e7955-dbdb-4240-8e79-f958c26a854e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.726623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0e7955-dbdb-4240-8e79-f958c26a854e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:37.727073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0e7955-dbdb-4240-8e79-f958c26a854e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:37.727490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0e7955-dbdb-4240-8e79-f958c26a854e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.757625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3d0e7955-dbdb-4240-8e79-f958c26a854e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Aug 29 22:54:37.758191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 959/1911] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:38.294658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:38.295325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:38.302292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.302769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.303194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.303877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.304360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.304777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.371533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:38.376371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-28d3d092-8ddf-43a8-98af-d031f5478331 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085526 Aug 29 22:54:38.376941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 953/1912] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:38 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:38.473245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5b3c77b3-e0dc-4a6a-8631-a61ed2a41a07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:38.475439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5b3c77b3-e0dc-4a6a-8631-a61ed2a41a07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:38.481920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b3c77b3-e0dc-4a6a-8631-a61ed2a41a07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.482396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b3c77b3-e0dc-4a6a-8631-a61ed2a41a07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.482826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b3c77b3-e0dc-4a6a-8631-a61ed2a41a07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.484084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b3c77b3-e0dc-4a6a-8631-a61ed2a41a07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.484644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b3c77b3-e0dc-4a6a-8631-a61ed2a41a07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.485069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b3c77b3-e0dc-4a6a-8631-a61ed2a41a07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.515556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5b3c77b3-e0dc-4a6a-8631-a61ed2a41a07 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046230 Aug 29 22:54:38.516104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 960/1913] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:38.770893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0d855c2d-9343-4d84-bbb1-6e4606d8c592 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:38.773075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0d855c2d-9343-4d84-bbb1-6e4606d8c592 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:38.779026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d855c2d-9343-4d84-bbb1-6e4606d8c592 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.779503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d855c2d-9343-4d84-bbb1-6e4606d8c592 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.780578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d855c2d-9343-4d84-bbb1-6e4606d8c592 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.781629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d855c2d-9343-4d84-bbb1-6e4606d8c592 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.782208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d855c2d-9343-4d84-bbb1-6e4606d8c592 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.782686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d855c2d-9343-4d84-bbb1-6e4606d8c592 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.808605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:38.813442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0d855c2d-9343-4d84-bbb1-6e4606d8c592 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047027 Aug 29 22:54:38.814010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 954/1914] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:39.396823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:39.397463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:39.403556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:39.404039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:39.404550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:39.406119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:39.406572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:39.406996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:39.472357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:39.481057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3ee54010-52e4-48e1-a1aa-7a2afada5592 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088154 Aug 29 22:54:39.481655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 961/1915] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:39 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:39.527906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bcb74f4c-b535-4489-a3a9-23033db84077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:39.530233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bcb74f4c-b535-4489-a3a9-23033db84077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:39.537303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcb74f4c-b535-4489-a3a9-23033db84077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:39.537775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcb74f4c-b535-4489-a3a9-23033db84077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:39.538205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcb74f4c-b535-4489-a3a9-23033db84077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:39.538892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcb74f4c-b535-4489-a3a9-23033db84077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:39.539345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcb74f4c-b535-4489-a3a9-23033db84077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:39.539762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcb74f4c-b535-4489-a3a9-23033db84077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:39.569700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bcb74f4c-b535-4489-a3a9-23033db84077 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Aug 29 22:54:39.570253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 955/1916] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:39.826390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-66aa2366-cab9-4989-ac2a-70336141aef6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:39.829003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-66aa2366-cab9-4989-ac2a-70336141aef6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:39.834980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66aa2366-cab9-4989-ac2a-70336141aef6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:39.835463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66aa2366-cab9-4989-ac2a-70336141aef6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:39.835893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66aa2366-cab9-4989-ac2a-70336141aef6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:39.836622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66aa2366-cab9-4989-ac2a-70336141aef6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:39.837074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66aa2366-cab9-4989-ac2a-70336141aef6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:39.837497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-66aa2366-cab9-4989-ac2a-70336141aef6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:39.868690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-66aa2366-cab9-4989-ac2a-70336141aef6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Aug 29 22:54:39.875728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 962/1917] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:40.501852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:40.502498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:40.508485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.508973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.509408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.510105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.510562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.510987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.576685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:40.582954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-15a8388e-8a31-40d7-8199-f0cd20a13607 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:40.585285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-15a8388e-8a31-40d7-8199-f0cd20a13607 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:40.587110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-354b671d-96c2-434c-8987-d8898727963b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089219 Aug 29 22:54:40.587977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 956/1918] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:40 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:40.592285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15a8388e-8a31-40d7-8199-f0cd20a13607 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.593400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15a8388e-8a31-40d7-8199-f0cd20a13607 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.593909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15a8388e-8a31-40d7-8199-f0cd20a13607 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.594766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15a8388e-8a31-40d7-8199-f0cd20a13607 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.595291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15a8388e-8a31-40d7-8199-f0cd20a13607 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.595815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15a8388e-8a31-40d7-8199-f0cd20a13607 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.628761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-15a8388e-8a31-40d7-8199-f0cd20a13607 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Aug 29 22:54:40.628761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 963/1919] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:40 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:40.885265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b84c14d3-4805-4d80-88ac-59c0d742dc2e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:40.887453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b84c14d3-4805-4d80-88ac-59c0d742dc2e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:40.894396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b84c14d3-4805-4d80-88ac-59c0d742dc2e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.894880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b84c14d3-4805-4d80-88ac-59c0d742dc2e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.895329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b84c14d3-4805-4d80-88ac-59c0d742dc2e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.896032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b84c14d3-4805-4d80-88ac-59c0d742dc2e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.896518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b84c14d3-4805-4d80-88ac-59c0d742dc2e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.896949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b84c14d3-4805-4d80-88ac-59c0d742dc2e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.928876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b84c14d3-4805-4d80-88ac-59c0d742dc2e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047668 Aug 29 22:54:40.929485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 957/1920] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:41.609021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:41.609645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:41.611986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=98 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:41.616655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.617134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.617563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:41.618246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.618692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.619108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:41.640151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b81fb125-f94a-4752-8276-c411f115898a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:41.642791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b81fb125-f94a-4752-8276-c411f115898a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:41.649355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b81fb125-f94a-4752-8276-c411f115898a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.649827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b81fb125-f94a-4752-8276-c411f115898a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.650260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b81fb125-f94a-4752-8276-c411f115898a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:41.650953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b81fb125-f94a-4752-8276-c411f115898a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.651463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b81fb125-f94a-4752-8276-c411f115898a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.651810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b81fb125-f94a-4752-8276-c411f115898a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:41.682146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:41.684731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b81fb125-f94a-4752-8276-c411f115898a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049163 Aug 29 22:54:41.685527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 958/1921] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:41.691006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6535e267-efe3-4577-8251-9559728bb34b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085866 Aug 29 22:54:41.691569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 964/1922] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:41 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:41.941994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7edcfb34-ed14-415b-b098-18a40125a735 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:41.944162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7edcfb34-ed14-415b-b098-18a40125a735 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:41.950185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7edcfb34-ed14-415b-b098-18a40125a735 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.950691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7edcfb34-ed14-415b-b098-18a40125a735 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.951148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7edcfb34-ed14-415b-b098-18a40125a735 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:41.952992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7edcfb34-ed14-415b-b098-18a40125a735 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.953450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7edcfb34-ed14-415b-b098-18a40125a735 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.953896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7edcfb34-ed14-415b-b098-18a40125a735 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:41.983587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7edcfb34-ed14-415b-b098-18a40125a735 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Aug 29 22:54:41.984181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 959/1923] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:42.697335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cdc242f0-4a49-4f5a-af5f-c64fa35eced8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:42.699521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cdc242f0-4a49-4f5a-af5f-c64fa35eced8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:42.706971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdc242f0-4a49-4f5a-af5f-c64fa35eced8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.707509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdc242f0-4a49-4f5a-af5f-c64fa35eced8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.707947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdc242f0-4a49-4f5a-af5f-c64fa35eced8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.708702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdc242f0-4a49-4f5a-af5f-c64fa35eced8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.709152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdc242f0-4a49-4f5a-af5f-c64fa35eced8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.709576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cdc242f0-4a49-4f5a-af5f-c64fa35eced8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.713656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:42.714304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:42.727766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.728407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.728867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.729636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.730085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.730569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.738153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:42.743511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cdc242f0-4a49-4f5a-af5f-c64fa35eced8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050201 Aug 29 22:54:42.749270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 965/1924] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:42.794835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:42.804006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e897ba4f-9dcc-47d0-aa00-a8a39d88dd91 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094281 Aug 29 22:54:42.804616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 960/1925] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:42 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:42.996397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-253791f8-da67-487f-98c2-141f36a9a99d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:42.998554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-253791f8-da67-487f-98c2-141f36a9a99d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:43.005922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253791f8-da67-487f-98c2-141f36a9a99d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.006405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253791f8-da67-487f-98c2-141f36a9a99d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.006839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253791f8-da67-487f-98c2-141f36a9a99d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.007537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253791f8-da67-487f-98c2-141f36a9a99d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.008063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253791f8-da67-487f-98c2-141f36a9a99d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.008443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-253791f8-da67-487f-98c2-141f36a9a99d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.038634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-253791f8-da67-487f-98c2-141f36a9a99d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Aug 29 22:54:43.039211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 966/1926] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:43.760240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5f2ce971-a8ab-4710-8945-df76137179f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:43.762356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5f2ce971-a8ab-4710-8945-df76137179f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:43.769487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f2ce971-a8ab-4710-8945-df76137179f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.769980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f2ce971-a8ab-4710-8945-df76137179f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.770419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f2ce971-a8ab-4710-8945-df76137179f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.771119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f2ce971-a8ab-4710-8945-df76137179f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.771578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f2ce971-a8ab-4710-8945-df76137179f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.772008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f2ce971-a8ab-4710-8945-df76137179f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.802516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5f2ce971-a8ab-4710-8945-df76137179f4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046355 Aug 29 22:54:43.803082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 961/1927] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:43.825170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:43.825797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:43.833880 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.834359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.834786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.835470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.835916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.836373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.902351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:43.910497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-294d2433-50aa-4d9d-bc82-c24f4aa227ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089127 Aug 29 22:54:43.911080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 967/1928] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:43 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:44.051826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-abc723a4-4fe0-4f4e-985e-413ce1f2074d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:44.053968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-abc723a4-4fe0-4f4e-985e-413ce1f2074d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:44.059901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abc723a4-4fe0-4f4e-985e-413ce1f2074d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.060418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abc723a4-4fe0-4f4e-985e-413ce1f2074d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.060848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abc723a4-4fe0-4f4e-985e-413ce1f2074d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.061623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abc723a4-4fe0-4f4e-985e-413ce1f2074d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.062174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abc723a4-4fe0-4f4e-985e-413ce1f2074d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.062592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-abc723a4-4fe0-4f4e-985e-413ce1f2074d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.091734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-abc723a4-4fe0-4f4e-985e-413ce1f2074d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Aug 29 22:54:44.092815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 962/1929] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:44.815232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c181baa0-8ebf-4d92-85e4-aa475f6f8d73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:44.817455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c181baa0-8ebf-4d92-85e4-aa475f6f8d73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:44.823513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c181baa0-8ebf-4d92-85e4-aa475f6f8d73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.823989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c181baa0-8ebf-4d92-85e4-aa475f6f8d73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.824474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c181baa0-8ebf-4d92-85e4-aa475f6f8d73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.825158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c181baa0-8ebf-4d92-85e4-aa475f6f8d73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.825158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c181baa0-8ebf-4d92-85e4-aa475f6f8d73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.826397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c181baa0-8ebf-4d92-85e4-aa475f6f8d73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.859570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c181baa0-8ebf-4d92-85e4-aa475f6f8d73 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049056 Aug 29 22:54:44.860145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 968/1930] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:44.932397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:44.933012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:44.941606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.942101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.942542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.943264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.943703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.944131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.009079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:45.016714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-207984cf-889b-41ee-9ffc-664f00895d14 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088315 Aug 29 22:54:45.017294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 963/1931] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:44 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:45.104898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ce967f7a-7d1f-449d-919e-6c47eb1d1ae8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:45.107004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ce967f7a-7d1f-449d-919e-6c47eb1d1ae8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:45.114407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce967f7a-7d1f-449d-919e-6c47eb1d1ae8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.114928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce967f7a-7d1f-449d-919e-6c47eb1d1ae8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.115401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce967f7a-7d1f-449d-919e-6c47eb1d1ae8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.116275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce967f7a-7d1f-449d-919e-6c47eb1d1ae8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.116853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce967f7a-7d1f-449d-919e-6c47eb1d1ae8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.117571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce967f7a-7d1f-449d-919e-6c47eb1d1ae8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.147989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ce967f7a-7d1f-449d-919e-6c47eb1d1ae8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047070 Aug 29 22:54:45.148570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 969/1932] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:45.872696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ee468c72-f167-454f-85ab-205dac1e86ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:45.875481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ee468c72-f167-454f-85ab-205dac1e86ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:45.881783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee468c72-f167-454f-85ab-205dac1e86ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.882272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee468c72-f167-454f-85ab-205dac1e86ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.882737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee468c72-f167-454f-85ab-205dac1e86ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.883430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee468c72-f167-454f-85ab-205dac1e86ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.883880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee468c72-f167-454f-85ab-205dac1e86ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.884329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ee468c72-f167-454f-85ab-205dac1e86ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.914481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ee468c72-f167-454f-85ab-205dac1e86ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Aug 29 22:54:45.915059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 964/1933] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:46.037410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:46.038045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:46.044505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.044990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.045919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.046678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.047115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.047532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.112067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:46.119726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef772267-01b7-4e6f-8d39-c04cb3d86dce tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086167 Aug 29 22:54:46.120328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 970/1934] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:46 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:46.160667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ea9083d5-bb2a-4e6b-b9dd-609c529d976e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:46.162858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ea9083d5-bb2a-4e6b-b9dd-609c529d976e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:46.169262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea9083d5-bb2a-4e6b-b9dd-609c529d976e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.169745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea9083d5-bb2a-4e6b-b9dd-609c529d976e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.170189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea9083d5-bb2a-4e6b-b9dd-609c529d976e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.171706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea9083d5-bb2a-4e6b-b9dd-609c529d976e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.172166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea9083d5-bb2a-4e6b-b9dd-609c529d976e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.172587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea9083d5-bb2a-4e6b-b9dd-609c529d976e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.203350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ea9083d5-bb2a-4e6b-b9dd-609c529d976e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 Aug 29 22:54:46.203913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 965/1935] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:46 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:46.928035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6cf2bc9e-0367-445a-a433-e210f5115f38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:46.930299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6cf2bc9e-0367-445a-a433-e210f5115f38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:46.937282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf2bc9e-0367-445a-a433-e210f5115f38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.937842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf2bc9e-0367-445a-a433-e210f5115f38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.938268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf2bc9e-0367-445a-a433-e210f5115f38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.939001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf2bc9e-0367-445a-a433-e210f5115f38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.939457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf2bc9e-0367-445a-a433-e210f5115f38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.939879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6cf2bc9e-0367-445a-a433-e210f5115f38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.972117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6cf2bc9e-0367-445a-a433-e210f5115f38 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048258 Aug 29 22:54:46.972732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 971/1936] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:47.141025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:47.141641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:47.147629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.149758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.149758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.149758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.149758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.150198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.215216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:47.215790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0cf9bb01-29a4-4933-914c-689cf6adfb41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:47.218608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0cf9bb01-29a4-4933-914c-689cf6adfb41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:47.224947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cf9bb01-29a4-4933-914c-689cf6adfb41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.225395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cf9bb01-29a4-4933-914c-689cf6adfb41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.225729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cf9bb01-29a4-4933-914c-689cf6adfb41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.226421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cf9bb01-29a4-4933-914c-689cf6adfb41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.226864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cf9bb01-29a4-4933-914c-689cf6adfb41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.226994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-65523b7f-8482-49c7-a5ec-6abcca33ba87 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090118 Aug 29 22:54:47.227279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cf9bb01-29a4-4933-914c-689cf6adfb41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.227466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 966/1937] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:47 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:47.261497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0cf9bb01-29a4-4933-914c-689cf6adfb41 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050224 Aug 29 22:54:47.262073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 972/1938] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:47.985543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-34866002-5bc0-4395-bd6f-861e449c07c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:47.987838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-34866002-5bc0-4395-bd6f-861e449c07c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:47.989943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=90 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:47.994622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34866002-5bc0-4395-bd6f-861e449c07c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.995101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34866002-5bc0-4395-bd6f-861e449c07c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.999407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34866002-5bc0-4395-bd6f-861e449c07c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.999407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34866002-5bc0-4395-bd6f-861e449c07c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.999407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34866002-5bc0-4395-bd6f-861e449c07c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.999407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-34866002-5bc0-4395-bd6f-861e449c07c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.030175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-34866002-5bc0-4395-bd6f-861e449c07c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048585 Aug 29 22:54:48.030820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 967/1939] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:48.249787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:48.250333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:48.256995 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.257482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.257915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.258637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.259080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.259504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.273828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a0a94b6d-36d7-472a-927f-716826c4faff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:48.275974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a0a94b6d-36d7-472a-927f-716826c4faff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:48.283045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0a94b6d-36d7-472a-927f-716826c4faff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.283536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0a94b6d-36d7-472a-927f-716826c4faff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.283975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0a94b6d-36d7-472a-927f-716826c4faff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.284721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0a94b6d-36d7-472a-927f-716826c4faff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.285180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0a94b6d-36d7-472a-927f-716826c4faff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.285612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0a94b6d-36d7-472a-927f-716826c4faff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.318971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a0a94b6d-36d7-472a-927f-716826c4faff tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049098 Aug 29 22:54:48.320107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 968/1940] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:48.322509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:48.330948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-57423c9c-766b-4163-a94c-5c94a7426d3c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085718 Aug 29 22:54:48.331527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 973/1941] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:48 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:49.042100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b5e9e298-a745-4fc6-bf7e-3b90e5fc770a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:49.044259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b5e9e298-a745-4fc6-bf7e-3b90e5fc770a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:49.050769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e9e298-a745-4fc6-bf7e-3b90e5fc770a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:49.051248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e9e298-a745-4fc6-bf7e-3b90e5fc770a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:49.051676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e9e298-a745-4fc6-bf7e-3b90e5fc770a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:49.052397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e9e298-a745-4fc6-bf7e-3b90e5fc770a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:49.052847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e9e298-a745-4fc6-bf7e-3b90e5fc770a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:49.053262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e9e298-a745-4fc6-bf7e-3b90e5fc770a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:49.083370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b5e9e298-a745-4fc6-bf7e-3b90e5fc770a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Aug 29 22:54:49.083929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 969/1942] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:49.331434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3ad4c1ea-5447-4f47-b0e4-d080e9e40f91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:49.333620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3ad4c1ea-5447-4f47-b0e4-d080e9e40f91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:49.339997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad4c1ea-5447-4f47-b0e4-d080e9e40f91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:49.340505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad4c1ea-5447-4f47-b0e4-d080e9e40f91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:49.340934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad4c1ea-5447-4f47-b0e4-d080e9e40f91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:49.341622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad4c1ea-5447-4f47-b0e4-d080e9e40f91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:49.342550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad4c1ea-5447-4f47-b0e4-d080e9e40f91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:49.342974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad4c1ea-5447-4f47-b0e4-d080e9e40f91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:49.351083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:49.351708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:49.358862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:49.359348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:49.359796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:49.360639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:49.361101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:49.361530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:49.375359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3ad4c1ea-5447-4f47-b0e4-d080e9e40f91 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048129 Aug 29 22:54:49.375938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 974/1943] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:49 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:49.426876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:49.435275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c40a8bc0-f508-4bc4-b66e-52c99d8f9d76 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088022 Aug 29 22:54:49.435887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 970/1944] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:49 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:50.096370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-33aecedf-7c90-4ac2-807e-279c823742a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:50.098489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-33aecedf-7c90-4ac2-807e-279c823742a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:50.104460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33aecedf-7c90-4ac2-807e-279c823742a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.104931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33aecedf-7c90-4ac2-807e-279c823742a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.105360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33aecedf-7c90-4ac2-807e-279c823742a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.106033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33aecedf-7c90-4ac2-807e-279c823742a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.106471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33aecedf-7c90-4ac2-807e-279c823742a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.106884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33aecedf-7c90-4ac2-807e-279c823742a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.136303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-33aecedf-7c90-4ac2-807e-279c823742a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Aug 29 22:54:50.136782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 975/1945] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:50.387229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-918e2c19-eebc-41b5-903e-8a8cd5a0d90a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:50.389964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-918e2c19-eebc-41b5-903e-8a8cd5a0d90a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:50.396839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-918e2c19-eebc-41b5-903e-8a8cd5a0d90a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.397312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-918e2c19-eebc-41b5-903e-8a8cd5a0d90a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.397744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-918e2c19-eebc-41b5-903e-8a8cd5a0d90a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.398467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-918e2c19-eebc-41b5-903e-8a8cd5a0d90a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.398899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-918e2c19-eebc-41b5-903e-8a8cd5a0d90a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.399323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-918e2c19-eebc-41b5-903e-8a8cd5a0d90a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.415199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:50.431670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-918e2c19-eebc-41b5-903e-8a8cd5a0d90a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048423 Aug 29 22:54:50.442479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 971/1946] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:50.456903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:50.457511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:50.463906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.464423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.464881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.465566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.466006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.466425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.530949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:50.539240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-311f0475-b6db-48e3-9e0b-65e76765e224 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086466 Aug 29 22:54:50.540015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 976/1947] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:50 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:51.151175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a920b858-ed42-4339-8ba1-ac8b72c0e234 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:51.153805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a920b858-ed42-4339-8ba1-ac8b72c0e234 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:51.161301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a920b858-ed42-4339-8ba1-ac8b72c0e234 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.161788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a920b858-ed42-4339-8ba1-ac8b72c0e234 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.163848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a920b858-ed42-4339-8ba1-ac8b72c0e234 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.163848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a920b858-ed42-4339-8ba1-ac8b72c0e234 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.163848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a920b858-ed42-4339-8ba1-ac8b72c0e234 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.163848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a920b858-ed42-4339-8ba1-ac8b72c0e234 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.195853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a920b858-ed42-4339-8ba1-ac8b72c0e234 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050266 Aug 29 22:54:51.196369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 972/1948] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:51.453559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-50e5794b-c7e0-43b1-9b9b-db53721f3b0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:51.455630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-50e5794b-c7e0-43b1-9b9b-db53721f3b0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:51.463260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50e5794b-c7e0-43b1-9b9b-db53721f3b0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.463897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50e5794b-c7e0-43b1-9b9b-db53721f3b0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.464196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50e5794b-c7e0-43b1-9b9b-db53721f3b0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.464913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50e5794b-c7e0-43b1-9b9b-db53721f3b0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.465367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50e5794b-c7e0-43b1-9b9b-db53721f3b0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.465794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50e5794b-c7e0-43b1-9b9b-db53721f3b0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.502615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-50e5794b-c7e0-43b1-9b9b-db53721f3b0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053337 Aug 29 22:54:51.503217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 977/1949] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:51.560608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:51.561276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:51.568376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.568859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.569326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.570020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.570469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.570885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.634205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:51.643635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1f419d0d-3354-411a-a6ff-86b941f507d5 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086914 Aug 29 22:54:51.644250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 973/1950] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:51 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:52.209391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f5bfc451-a125-43cc-a81d-f0ed6b664496 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:52.211577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f5bfc451-a125-43cc-a81d-f0ed6b664496 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:52.217621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5bfc451-a125-43cc-a81d-f0ed6b664496 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.218209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5bfc451-a125-43cc-a81d-f0ed6b664496 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.218647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5bfc451-a125-43cc-a81d-f0ed6b664496 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.219349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5bfc451-a125-43cc-a81d-f0ed6b664496 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.219805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5bfc451-a125-43cc-a81d-f0ed6b664496 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.220255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5bfc451-a125-43cc-a81d-f0ed6b664496 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.250001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f5bfc451-a125-43cc-a81d-f0ed6b664496 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Aug 29 22:54:52.250568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 978/1951] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:52.515844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b413b155-8aa6-474e-8627-288756076a67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:52.517999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b413b155-8aa6-474e-8627-288756076a67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:52.524196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b413b155-8aa6-474e-8627-288756076a67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.524687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b413b155-8aa6-474e-8627-288756076a67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.525127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b413b155-8aa6-474e-8627-288756076a67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.525829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b413b155-8aa6-474e-8627-288756076a67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.526288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b413b155-8aa6-474e-8627-288756076a67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.526716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b413b155-8aa6-474e-8627-288756076a67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.557072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b413b155-8aa6-474e-8627-288756076a67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046041 Aug 29 22:54:52.557643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 974/1952] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:52.666482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:52.667093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:52.674042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.674526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.674965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.675658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.676110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.676565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.739299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:52.747086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a294da5d-135f-47ac-88c3-9a1f3fbb9d48 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084578 Aug 29 22:54:52.747658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 979/1953] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:52 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:53.262763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4f90511d-cb83-4f77-a734-6793848e368d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:53.265603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4f90511d-cb83-4f77-a734-6793848e368d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:53.271667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f90511d-cb83-4f77-a734-6793848e368d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.272163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f90511d-cb83-4f77-a734-6793848e368d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.272618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f90511d-cb83-4f77-a734-6793848e368d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.273317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f90511d-cb83-4f77-a734-6793848e368d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.273773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f90511d-cb83-4f77-a734-6793848e368d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.274197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f90511d-cb83-4f77-a734-6793848e368d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.304928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4f90511d-cb83-4f77-a734-6793848e368d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046164 Aug 29 22:54:53.305498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 975/1954] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:53 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:53.570541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3d0058ca-4e62-4da4-bff1-05c058b3b623 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:53.572659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3d0058ca-4e62-4da4-bff1-05c058b3b623 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:53.579945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0058ca-4e62-4da4-bff1-05c058b3b623 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.580452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0058ca-4e62-4da4-bff1-05c058b3b623 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.580912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0058ca-4e62-4da4-bff1-05c058b3b623 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.581598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0058ca-4e62-4da4-bff1-05c058b3b623 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.582042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0058ca-4e62-4da4-bff1-05c058b3b623 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.582460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d0058ca-4e62-4da4-bff1-05c058b3b623 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.615346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3d0058ca-4e62-4da4-bff1-05c058b3b623 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048774 Aug 29 22:54:53.616061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 980/1955] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:53.769793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:53.770633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:53.777204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.777684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.778113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.778793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.779247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.779930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.842972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:53.851164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-54709a15-2e4a-45ad-aee6-ed67fffb31f8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085174 Aug 29 22:54:53.851743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 976/1956] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:53 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:54.318263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-18eeedcb-85f7-4b61-8bae-d8711d50b5dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:54.320459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-18eeedcb-85f7-4b61-8bae-d8711d50b5dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:54.326714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eeedcb-85f7-4b61-8bae-d8711d50b5dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.327196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eeedcb-85f7-4b61-8bae-d8711d50b5dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.327887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eeedcb-85f7-4b61-8bae-d8711d50b5dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:54.328612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eeedcb-85f7-4b61-8bae-d8711d50b5dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.329069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eeedcb-85f7-4b61-8bae-d8711d50b5dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.329482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18eeedcb-85f7-4b61-8bae-d8711d50b5dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:54.359901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-18eeedcb-85f7-4b61-8bae-d8711d50b5dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045628 Aug 29 22:54:54.360516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 981/1957] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:54.628084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b3d3452a-1adb-4802-af7e-753f9ec774dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:54.630268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b3d3452a-1adb-4802-af7e-753f9ec774dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:54.636283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3d3452a-1adb-4802-af7e-753f9ec774dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.636763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3d3452a-1adb-4802-af7e-753f9ec774dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.637188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3d3452a-1adb-4802-af7e-753f9ec774dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:54.637875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3d3452a-1adb-4802-af7e-753f9ec774dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.638324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3d3452a-1adb-4802-af7e-753f9ec774dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.638747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3d3452a-1adb-4802-af7e-753f9ec774dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:54.668397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b3d3452a-1adb-4802-af7e-753f9ec774dc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Aug 29 22:54:54.668951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 977/1958] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:54.872262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:54.872864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:54.879614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.880017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.880497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:54.881175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.881618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.882138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:54.901766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:54.949694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:54.958324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c1f597c2-2b11-439a-b9b5-f80d2ccbf318 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089891 Aug 29 22:54:54.958894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 982/1959] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:54 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:55.372580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6f3bf4b0-90d2-4ec3-b1aa-d74d0dd2bca5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:55.375300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6f3bf4b0-90d2-4ec3-b1aa-d74d0dd2bca5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:55.382031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3bf4b0-90d2-4ec3-b1aa-d74d0dd2bca5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.382508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3bf4b0-90d2-4ec3-b1aa-d74d0dd2bca5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.382993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3bf4b0-90d2-4ec3-b1aa-d74d0dd2bca5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.383731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3bf4b0-90d2-4ec3-b1aa-d74d0dd2bca5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.384218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3bf4b0-90d2-4ec3-b1aa-d74d0dd2bca5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.384640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3bf4b0-90d2-4ec3-b1aa-d74d0dd2bca5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.415837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6f3bf4b0-90d2-4ec3-b1aa-d74d0dd2bca5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047388 Aug 29 22:54:55.416437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 978/1960] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:55.681358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3166d7be-7442-440e-b022-c1d8b4ba4d1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:55.683480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3166d7be-7442-440e-b022-c1d8b4ba4d1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:55.690165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3166d7be-7442-440e-b022-c1d8b4ba4d1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.690647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3166d7be-7442-440e-b022-c1d8b4ba4d1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.691084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3166d7be-7442-440e-b022-c1d8b4ba4d1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.691783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3166d7be-7442-440e-b022-c1d8b4ba4d1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.692264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3166d7be-7442-440e-b022-c1d8b4ba4d1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.692686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3166d7be-7442-440e-b022-c1d8b4ba4d1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.722659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3166d7be-7442-440e-b022-c1d8b4ba4d1c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Aug 29 22:54:55.723229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 983/1961] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:55.978879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:55.979406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:55.987037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.987521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.987952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.988682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.989127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.990155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:56.051069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:56.058861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4099b3cf-f681-4a35-971e-5223e8ae61d1 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084091 Aug 29 22:54:56.059435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 979/1962] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:55 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:56.428306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8fc81759-d3bb-4da2-8656-fc5c00c936ee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:56.430402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8fc81759-d3bb-4da2-8656-fc5c00c936ee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:56.437151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fc81759-d3bb-4da2-8656-fc5c00c936ee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:56.437627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fc81759-d3bb-4da2-8656-fc5c00c936ee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:56.438053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fc81759-d3bb-4da2-8656-fc5c00c936ee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:56.438743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fc81759-d3bb-4da2-8656-fc5c00c936ee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:56.439187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fc81759-d3bb-4da2-8656-fc5c00c936ee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:56.439602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8fc81759-d3bb-4da2-8656-fc5c00c936ee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:56.473066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8fc81759-d3bb-4da2-8656-fc5c00c936ee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047352 Aug 29 22:54:56.473401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 984/1963] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:56.736768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fad89f98-242e-493c-9d84-99e715445678 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:56.738879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fad89f98-242e-493c-9d84-99e715445678 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:56.745768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fad89f98-242e-493c-9d84-99e715445678 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:56.746255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fad89f98-242e-493c-9d84-99e715445678 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:56.746692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fad89f98-242e-493c-9d84-99e715445678 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:56.747405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fad89f98-242e-493c-9d84-99e715445678 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:56.747882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fad89f98-242e-493c-9d84-99e715445678 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:56.748941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fad89f98-242e-493c-9d84-99e715445678 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:56.783081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fad89f98-242e-493c-9d84-99e715445678 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050808 Aug 29 22:54:56.783672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 980/1964] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:57.079445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:57.079999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:57.085966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.086447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.086879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.087569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.088019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.088478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.151465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:57.159577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8a18f439-e163-4662-a4b7-44d77f5f2546 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084645 Aug 29 22:54:57.160281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 985/1965] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:57 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:57.486879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7cd76962-a0ad-48f6-bd4a-06f9f99092ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:57.489124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7cd76962-a0ad-48f6-bd4a-06f9f99092ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:57.495296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7cd76962-a0ad-48f6-bd4a-06f9f99092ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.496423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7cd76962-a0ad-48f6-bd4a-06f9f99092ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.496873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7cd76962-a0ad-48f6-bd4a-06f9f99092ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.498119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7cd76962-a0ad-48f6-bd4a-06f9f99092ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.498882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7cd76962-a0ad-48f6-bd4a-06f9f99092ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.499364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7cd76962-a0ad-48f6-bd4a-06f9f99092ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.532470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7cd76962-a0ad-48f6-bd4a-06f9f99092ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050457 Aug 29 22:54:57.533053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 981/1966] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:57.796203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-32d53f9a-d776-473f-a7c5-6c8dfd74c206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:57.798454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-32d53f9a-d776-473f-a7c5-6c8dfd74c206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:57.805252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32d53f9a-d776-473f-a7c5-6c8dfd74c206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.805736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32d53f9a-d776-473f-a7c5-6c8dfd74c206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.806172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32d53f9a-d776-473f-a7c5-6c8dfd74c206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.806872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32d53f9a-d776-473f-a7c5-6c8dfd74c206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.807324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32d53f9a-d776-473f-a7c5-6c8dfd74c206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.807749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-32d53f9a-d776-473f-a7c5-6c8dfd74c206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.840692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-32d53f9a-d776-473f-a7c5-6c8dfd74c206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049273 Aug 29 22:54:57.841281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 986/1967] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:58.180113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:58.180741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:58.187814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.188321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.188756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.189461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.189916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.190339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.255030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:58.262778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eff7cc94-e7e5-4fe7-959e-17f9d5c8f006 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086524 Aug 29 22:54:58.263343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 982/1968] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:58 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:58.545888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c0c72c0e-9b0d-4300-bb67-36bdcb6b860f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:58.548073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c0c72c0e-9b0d-4300-bb67-36bdcb6b860f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:58.554235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0c72c0e-9b0d-4300-bb67-36bdcb6b860f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.554722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0c72c0e-9b0d-4300-bb67-36bdcb6b860f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.555158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0c72c0e-9b0d-4300-bb67-36bdcb6b860f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.555894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0c72c0e-9b0d-4300-bb67-36bdcb6b860f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.556371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0c72c0e-9b0d-4300-bb67-36bdcb6b860f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.556800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0c72c0e-9b0d-4300-bb67-36bdcb6b860f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.588665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c0c72c0e-9b0d-4300-bb67-36bdcb6b860f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Aug 29 22:54:58.589237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 987/1969] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:58.854326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80eaac34-1998-4631-8a95-3dcfcc397727 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:58.856438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-80eaac34-1998-4631-8a95-3dcfcc397727 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:58.864555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80eaac34-1998-4631-8a95-3dcfcc397727 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.865045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80eaac34-1998-4631-8a95-3dcfcc397727 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.865485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80eaac34-1998-4631-8a95-3dcfcc397727 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.866193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80eaac34-1998-4631-8a95-3dcfcc397727 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.866654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80eaac34-1998-4631-8a95-3dcfcc397727 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.867085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80eaac34-1998-4631-8a95-3dcfcc397727 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.901785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-80eaac34-1998-4631-8a95-3dcfcc397727 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051575 Aug 29 22:54:58.904247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 983/1970] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:59.285026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:59.285646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:59.292103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.292611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.293041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.293721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.294173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.294588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.364708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:59.372674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2bbc7e77-854c-48e4-9ad8-679d90131ead tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091671 Aug 29 22:54:59.373248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 988/1971] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:59 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:59.600935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-75fa1caf-3c5a-4252-bfe1-edbbdfec80b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:59.603220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-75fa1caf-3c5a-4252-bfe1-edbbdfec80b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:59.610033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75fa1caf-3c5a-4252-bfe1-edbbdfec80b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.610513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75fa1caf-3c5a-4252-bfe1-edbbdfec80b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.610948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75fa1caf-3c5a-4252-bfe1-edbbdfec80b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.611653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75fa1caf-3c5a-4252-bfe1-edbbdfec80b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.612316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75fa1caf-3c5a-4252-bfe1-edbbdfec80b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.612697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75fa1caf-3c5a-4252-bfe1-edbbdfec80b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.646083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-75fa1caf-3c5a-4252-bfe1-edbbdfec80b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049338 Aug 29 22:54:59.646651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 984/1972] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:59.914888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-910657d4-8089-46ad-9f59-702987878c59 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:59.917382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-910657d4-8089-46ad-9f59-702987878c59 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:59.923932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-910657d4-8089-46ad-9f59-702987878c59 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.924451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-910657d4-8089-46ad-9f59-702987878c59 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.924883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-910657d4-8089-46ad-9f59-702987878c59 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.925596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-910657d4-8089-46ad-9f59-702987878c59 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.926043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-910657d4-8089-46ad-9f59-702987878c59 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.926500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-910657d4-8089-46ad-9f59-702987878c59 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.962781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-910657d4-8089-46ad-9f59-702987878c59 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052071 Aug 29 22:54:59.963355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 989/1973] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:00.393763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:00.394436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:00.400734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.401222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.401753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.402449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.402900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.403323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.470306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:00.481175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-08f35ba5-8fab-4092-9906-aa1d64233755 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091565 Aug 29 22:55:00.481804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 985/1974] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:00 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:00.659343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-df9da02f-ee61-45be-8721-0ab1a632164f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:00.661487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-df9da02f-ee61-45be-8721-0ab1a632164f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:00.668159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df9da02f-ee61-45be-8721-0ab1a632164f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.668654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df9da02f-ee61-45be-8721-0ab1a632164f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.669092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df9da02f-ee61-45be-8721-0ab1a632164f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.669814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df9da02f-ee61-45be-8721-0ab1a632164f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.670932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df9da02f-ee61-45be-8721-0ab1a632164f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.671354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df9da02f-ee61-45be-8721-0ab1a632164f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.703109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-df9da02f-ee61-45be-8721-0ab1a632164f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047824 Aug 29 22:55:00.703730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 990/1975] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:00.976439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c822b79c-fae4-430d-922f-f209a6e7d48e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:00.978848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c822b79c-fae4-430d-922f-f209a6e7d48e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:00.986500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c822b79c-fae4-430d-922f-f209a6e7d48e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.986986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c822b79c-fae4-430d-922f-f209a6e7d48e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.987430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c822b79c-fae4-430d-922f-f209a6e7d48e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.988163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c822b79c-fae4-430d-922f-f209a6e7d48e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.988619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c822b79c-fae4-430d-922f-f209a6e7d48e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.989041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c822b79c-fae4-430d-922f-f209a6e7d48e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.021793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c822b79c-fae4-430d-922f-f209a6e7d48e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050645 Aug 29 22:55:01.023571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 986/1976] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:01.505296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:01.506018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:01.513348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.514160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.514748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.515704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.516380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.516947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.604014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:01.612254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-acda884b-d39e-4f5d-bbbd-07eddcc47cf4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.111651 Aug 29 22:55:01.612844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 991/1977] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:01 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:01.717661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-28b2828d-f069-4ebd-84e4-dd5f6cdb7d6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:01.720370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-28b2828d-f069-4ebd-84e4-dd5f6cdb7d6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:01.730286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28b2828d-f069-4ebd-84e4-dd5f6cdb7d6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.730286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28b2828d-f069-4ebd-84e4-dd5f6cdb7d6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.730286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28b2828d-f069-4ebd-84e4-dd5f6cdb7d6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.730286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28b2828d-f069-4ebd-84e4-dd5f6cdb7d6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.730817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28b2828d-f069-4ebd-84e4-dd5f6cdb7d6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.730817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28b2828d-f069-4ebd-84e4-dd5f6cdb7d6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.764782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-28b2828d-f069-4ebd-84e4-dd5f6cdb7d6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051705 Aug 29 22:55:01.765609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 987/1978] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:02.035768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0ceb1e5d-fa6e-428e-98aa-edbac28c0a96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:02.038020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0ceb1e5d-fa6e-428e-98aa-edbac28c0a96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:02.045106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ceb1e5d-fa6e-428e-98aa-edbac28c0a96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.045792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ceb1e5d-fa6e-428e-98aa-edbac28c0a96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.046284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ceb1e5d-fa6e-428e-98aa-edbac28c0a96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.047000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ceb1e5d-fa6e-428e-98aa-edbac28c0a96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.047456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ceb1e5d-fa6e-428e-98aa-edbac28c0a96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.047938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ceb1e5d-fa6e-428e-98aa-edbac28c0a96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.081833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0ceb1e5d-fa6e-428e-98aa-edbac28c0a96 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050094 Aug 29 22:55:02.082422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 992/1979] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:02.633553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:02.634158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:02.641354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.641837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.642271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.642971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.643421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.643838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.646571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:02.707295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:02.715326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-729cc9f8-c717-4da5-949c-0dd04a72a961 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085666 Aug 29 22:55:02.715907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 988/1980] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:02 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:02.777152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-244fab62-47c7-444c-afc3-acd5f71ab641 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:02.779338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-244fab62-47c7-444c-afc3-acd5f71ab641 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:02.785567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-244fab62-47c7-444c-afc3-acd5f71ab641 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.786047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-244fab62-47c7-444c-afc3-acd5f71ab641 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.786473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-244fab62-47c7-444c-afc3-acd5f71ab641 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.787152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-244fab62-47c7-444c-afc3-acd5f71ab641 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.787593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-244fab62-47c7-444c-afc3-acd5f71ab641 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.788007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-244fab62-47c7-444c-afc3-acd5f71ab641 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.819232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-244fab62-47c7-444c-afc3-acd5f71ab641 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Aug 29 22:55:02.819807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 993/1981] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:03.094574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-401ec87f-62ee-45a1-84f2-b3ee56eeb802 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:03.096761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-401ec87f-62ee-45a1-84f2-b3ee56eeb802 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:03.102724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-401ec87f-62ee-45a1-84f2-b3ee56eeb802 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.103204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-401ec87f-62ee-45a1-84f2-b3ee56eeb802 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.103633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-401ec87f-62ee-45a1-84f2-b3ee56eeb802 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.104361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-401ec87f-62ee-45a1-84f2-b3ee56eeb802 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.104837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-401ec87f-62ee-45a1-84f2-b3ee56eeb802 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.105256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-401ec87f-62ee-45a1-84f2-b3ee56eeb802 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.142993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-401ec87f-62ee-45a1-84f2-b3ee56eeb802 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052866 Aug 29 22:55:03.143552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 989/1982] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:03.740744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:03.741390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:03.748544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.749035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.749471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.750169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.750617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.751040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.817761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:03.825653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cd658b2f-8c56-4915-9e72-7136c8c0f069 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093381 Aug 29 22:55:03.826208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 994/1983] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:03 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:03.831973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-343649f4-7cf2-4cce-be3d-239c055bcc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:03.834486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-343649f4-7cf2-4cce-be3d-239c055bcc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:03.841156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-343649f4-7cf2-4cce-be3d-239c055bcc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.842458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-343649f4-7cf2-4cce-be3d-239c055bcc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.843243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-343649f4-7cf2-4cce-be3d-239c055bcc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.844005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-343649f4-7cf2-4cce-be3d-239c055bcc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.844488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-343649f4-7cf2-4cce-be3d-239c055bcc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.844913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-343649f4-7cf2-4cce-be3d-239c055bcc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.877168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-343649f4-7cf2-4cce-be3d-239c055bcc0b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049994 Aug 29 22:55:03.877799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 990/1984] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:04.155835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7f64dffd-7e97-4251-9293-4be157a2fafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:04.158071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7f64dffd-7e97-4251-9293-4be157a2fafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:04.164161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f64dffd-7e97-4251-9293-4be157a2fafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:04.164642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f64dffd-7e97-4251-9293-4be157a2fafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:04.165075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f64dffd-7e97-4251-9293-4be157a2fafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:04.165771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f64dffd-7e97-4251-9293-4be157a2fafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:04.166227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f64dffd-7e97-4251-9293-4be157a2fafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:04.166642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f64dffd-7e97-4251-9293-4be157a2fafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:04.196786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7f64dffd-7e97-4251-9293-4be157a2fafc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Aug 29 22:55:04.197342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 995/1985] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:04.847835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:04.848472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:04.855274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:04.855800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:04.856256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:04.856956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:04.857527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:04.857950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:04.891905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-820c29e0-3654-4048-9243-24be8046059a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:04.894443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-820c29e0-3654-4048-9243-24be8046059a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:04.902273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-820c29e0-3654-4048-9243-24be8046059a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:04.902761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-820c29e0-3654-4048-9243-24be8046059a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:04.903201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-820c29e0-3654-4048-9243-24be8046059a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:04.903910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-820c29e0-3654-4048-9243-24be8046059a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:04.904413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-820c29e0-3654-4048-9243-24be8046059a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:04.905875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-820c29e0-3654-4048-9243-24be8046059a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:04.928175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:04.937038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1972ed28-0f0a-471f-bc53-5cc939053e0a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093047 Aug 29 22:55:04.937958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 991/1986] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:04 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:04.943192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-820c29e0-3654-4048-9243-24be8046059a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057267 Aug 29 22:55:04.943779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 996/1987] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:05.210342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a2226ea5-da68-4cfc-9b59-62684aae4ebf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:05.212543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a2226ea5-da68-4cfc-9b59-62684aae4ebf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:05.218933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2226ea5-da68-4cfc-9b59-62684aae4ebf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.219419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2226ea5-da68-4cfc-9b59-62684aae4ebf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.219881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2226ea5-da68-4cfc-9b59-62684aae4ebf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.220612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2226ea5-da68-4cfc-9b59-62684aae4ebf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.221060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2226ea5-da68-4cfc-9b59-62684aae4ebf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.221511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2226ea5-da68-4cfc-9b59-62684aae4ebf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.252947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a2226ea5-da68-4cfc-9b59-62684aae4ebf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046542 Aug 29 22:55:05.253516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 992/1988] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:05.957820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a6fe2954-52ea-4b71-82c2-e6bd3c2575a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:05.959991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a6fe2954-52ea-4b71-82c2-e6bd3c2575a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:05.960947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:05.961564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:05.967517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6fe2954-52ea-4b71-82c2-e6bd3c2575a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.968054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6fe2954-52ea-4b71-82c2-e6bd3c2575a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.968569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6fe2954-52ea-4b71-82c2-e6bd3c2575a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.968999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.969291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6fe2954-52ea-4b71-82c2-e6bd3c2575a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.969414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.969704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6fe2954-52ea-4b71-82c2-e6bd3c2575a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.969850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.970134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6fe2954-52ea-4b71-82c2-e6bd3c2575a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.970548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.971002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.971429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.002209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a6fe2954-52ea-4b71-82c2-e6bd3c2575a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048637 Aug 29 22:55:06.002788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 997/1989] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:05 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:06.037089 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:06.044804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-166e141f-9be9-4b1e-9129-99c378adf947 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087647 Aug 29 22:55:06.045413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 993/1990] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:05 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:06.266404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-720aa1d8-4f4e-48fd-93b3-7c4a80e74339 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:06.268534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-720aa1d8-4f4e-48fd-93b3-7c4a80e74339 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:06.274551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-720aa1d8-4f4e-48fd-93b3-7c4a80e74339 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:06.275023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-720aa1d8-4f4e-48fd-93b3-7c4a80e74339 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:06.275445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-720aa1d8-4f4e-48fd-93b3-7c4a80e74339 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.276128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-720aa1d8-4f4e-48fd-93b3-7c4a80e74339 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:06.276594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-720aa1d8-4f4e-48fd-93b3-7c4a80e74339 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:06.277010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-720aa1d8-4f4e-48fd-93b3-7c4a80e74339 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.306547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-720aa1d8-4f4e-48fd-93b3-7c4a80e74339 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044963 Aug 29 22:55:06.307109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 998/1991] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:55:07.015526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5d3311c4-11e9-46f0-9212-710cc234a25e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:07.017799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5d3311c4-11e9-46f0-9212-710cc234a25e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:07.024439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5d3311c4-11e9-46f0-9212-710cc234a25e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.024926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5d3311c4-11e9-46f0-9212-710cc234a25e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.025358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5d3311c4-11e9-46f0-9212-710cc234a25e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.026057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5d3311c4-11e9-46f0-9212-710cc234a25e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.026510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5d3311c4-11e9-46f0-9212-710cc234a25e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.026941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5d3311c4-11e9-46f0-9212-710cc234a25e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.057454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5d3311c4-11e9-46f0-9212-710cc234a25e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046775 Aug 29 22:55:07.058013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 994/1992] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:07.065920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:07.066559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:07.073089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.073589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.074027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.074724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.075181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.075609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.080583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:07.138962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:07.146740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9ba40be2-a3d6-46b8-85b2-b2c7fb27980d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084711 Aug 29 22:55:07.147294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 999/1993] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:07 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:07.319255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-439c28ab-03e2-4274-8259-022c6023dde0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:07.321634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-439c28ab-03e2-4274-8259-022c6023dde0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:07.328595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-439c28ab-03e2-4274-8259-022c6023dde0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.329083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-439c28ab-03e2-4274-8259-022c6023dde0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.329515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-439c28ab-03e2-4274-8259-022c6023dde0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.330217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-439c28ab-03e2-4274-8259-022c6023dde0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.330674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-439c28ab-03e2-4274-8259-022c6023dde0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.331099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-439c28ab-03e2-4274-8259-022c6023dde0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.365577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-439c28ab-03e2-4274-8259-022c6023dde0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050285 Aug 29 22:55:07.366183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 995/1994] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:08.070221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bb121790-1e22-4775-afe1-6593c8a201c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:08.072437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bb121790-1e22-4775-afe1-6593c8a201c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:08.079217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb121790-1e22-4775-afe1-6593c8a201c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.079702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb121790-1e22-4775-afe1-6593c8a201c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.080221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb121790-1e22-4775-afe1-6593c8a201c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.080865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb121790-1e22-4775-afe1-6593c8a201c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.081327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb121790-1e22-4775-afe1-6593c8a201c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.081779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb121790-1e22-4775-afe1-6593c8a201c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.112107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bb121790-1e22-4775-afe1-6593c8a201c4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045801 Aug 29 22:55:08.112717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1000/1995] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:08.167635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:08.168193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:08.175316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.175810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.176279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.176987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.177464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.177880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.239820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:08.247833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a99e0bc6-5b78-4fc8-9037-a7f49f842d6b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084140 Aug 29 22:55:08.248430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 996/1996] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:08 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:08.377736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-70861548-5102-4477-9bbf-4793a8b03fc3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:08.379927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-70861548-5102-4477-9bbf-4793a8b03fc3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:08.386086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70861548-5102-4477-9bbf-4793a8b03fc3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.386591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70861548-5102-4477-9bbf-4793a8b03fc3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.387024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70861548-5102-4477-9bbf-4793a8b03fc3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.387712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70861548-5102-4477-9bbf-4793a8b03fc3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.388192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70861548-5102-4477-9bbf-4793a8b03fc3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.388630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70861548-5102-4477-9bbf-4793a8b03fc3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.420281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-70861548-5102-4477-9bbf-4793a8b03fc3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046655 Aug 29 22:55:08.421398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1001/1997] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:09.124891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d2a36201-09be-498e-94e3-d397a12ff00b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:09.127058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d2a36201-09be-498e-94e3-d397a12ff00b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:09.133153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2a36201-09be-498e-94e3-d397a12ff00b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.133627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2a36201-09be-498e-94e3-d397a12ff00b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.134057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2a36201-09be-498e-94e3-d397a12ff00b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.134745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2a36201-09be-498e-94e3-d397a12ff00b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.135188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2a36201-09be-498e-94e3-d397a12ff00b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.135602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d2a36201-09be-498e-94e3-d397a12ff00b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.165150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d2a36201-09be-498e-94e3-d397a12ff00b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Aug 29 22:55:09.165708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 997/1998] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:09 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:09.269555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:09.270190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:09.276768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.277247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.277681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.278374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.278826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.279246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.341273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:09.349037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-44f1823e-4d2b-46e5-89d8-95a9195d3170 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084042 Aug 29 22:55:09.349598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1002/1999] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:09 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:09.433390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6a51768a-e755-44de-963f-2096eb68d3da tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:09.435623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6a51768a-e755-44de-963f-2096eb68d3da tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:09.442794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a51768a-e755-44de-963f-2096eb68d3da tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.443277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a51768a-e755-44de-963f-2096eb68d3da tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.443733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a51768a-e755-44de-963f-2096eb68d3da tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.444437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a51768a-e755-44de-963f-2096eb68d3da tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.444888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a51768a-e755-44de-963f-2096eb68d3da tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.445310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a51768a-e755-44de-963f-2096eb68d3da tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.475184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6a51768a-e755-44de-963f-2096eb68d3da tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045659 Aug 29 22:55:09.475654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 998/2000] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:10.179385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d236edbe-9191-43f2-9cac-0bc1ebaa056c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:10.181602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d236edbe-9191-43f2-9cac-0bc1ebaa056c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:10.188595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d236edbe-9191-43f2-9cac-0bc1ebaa056c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.189069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d236edbe-9191-43f2-9cac-0bc1ebaa056c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.189503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d236edbe-9191-43f2-9cac-0bc1ebaa056c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.190271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d236edbe-9191-43f2-9cac-0bc1ebaa056c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.190721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d236edbe-9191-43f2-9cac-0bc1ebaa056c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.191146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d236edbe-9191-43f2-9cac-0bc1ebaa056c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.221671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d236edbe-9191-43f2-9cac-0bc1ebaa056c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Aug 29 22:55:10.222240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1003/2001] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:10.370345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:10.370954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:10.378141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.378639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.379105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.379803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.380291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.380721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.443831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:10.452279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fdd49fc2-e12d-441c-a768-6eb563e1968e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085593 Aug 29 22:55:10.453163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 999/2002] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:10 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:10.487509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a2771c97-752e-4859-804c-4d6db2bce1f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:10.489696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a2771c97-752e-4859-804c-4d6db2bce1f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:10.496217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2771c97-752e-4859-804c-4d6db2bce1f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.496718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2771c97-752e-4859-804c-4d6db2bce1f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.497132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2771c97-752e-4859-804c-4d6db2bce1f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.497896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2771c97-752e-4859-804c-4d6db2bce1f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.498264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2771c97-752e-4859-804c-4d6db2bce1f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.499345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a2771c97-752e-4859-804c-4d6db2bce1f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.528723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a2771c97-752e-4859-804c-4d6db2bce1f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Aug 29 22:55:10.529291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1004/2003] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:11.233920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0ebdf12a-c985-44b6-a0bc-44fefff375d7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:11.235980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0ebdf12a-c985-44b6-a0bc-44fefff375d7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:11.242806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ebdf12a-c985-44b6-a0bc-44fefff375d7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.242806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ebdf12a-c985-44b6-a0bc-44fefff375d7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.243196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ebdf12a-c985-44b6-a0bc-44fefff375d7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.243917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ebdf12a-c985-44b6-a0bc-44fefff375d7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.244405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ebdf12a-c985-44b6-a0bc-44fefff375d7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.244841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0ebdf12a-c985-44b6-a0bc-44fefff375d7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.275604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0ebdf12a-c985-44b6-a0bc-44fefff375d7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Aug 29 22:55:11.276186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1000/2004] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:11 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:11.473285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:11.473893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:11.479956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.480463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.480890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.481571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.482015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.482432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.540797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1da6839d-6ede-49e1-b4b5-6173cc316d24 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:11.543024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1da6839d-6ede-49e1-b4b5-6173cc316d24 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:11.546579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:11.550389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1da6839d-6ede-49e1-b4b5-6173cc316d24 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.550883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1da6839d-6ede-49e1-b4b5-6173cc316d24 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.551347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1da6839d-6ede-49e1-b4b5-6173cc316d24 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.552054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1da6839d-6ede-49e1-b4b5-6173cc316d24 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.552542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1da6839d-6ede-49e1-b4b5-6173cc316d24 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.552971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1da6839d-6ede-49e1-b4b5-6173cc316d24 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.554824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-51b24698-2040-4448-b65b-8e5cfdab6946 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085344 Aug 29 22:55:11.555631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1005/2005] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:11 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:11.645522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1da6839d-6ede-49e1-b4b5-6173cc316d24 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "POST /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/action" status: 200 len: 38436 microversion: 2.1 time: 0.108381 Aug 29 22:55:11.646167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1001/2006] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:55:11 2022] POST /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7/action => generated 38436 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:55:12.288197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-39c64189-0b2c-4559-a452-d271052ec6e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:12.290263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-39c64189-0b2c-4559-a452-d271052ec6e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:12.292200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=84 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:12.297673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c64189-0b2c-4559-a452-d271052ec6e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:12.298145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c64189-0b2c-4559-a452-d271052ec6e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:12.298576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c64189-0b2c-4559-a452-d271052ec6e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:12.299263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c64189-0b2c-4559-a452-d271052ec6e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:12.299706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c64189-0b2c-4559-a452-d271052ec6e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:12.300118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c64189-0b2c-4559-a452-d271052ec6e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:12.331703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-39c64189-0b2c-4559-a452-d271052ec6e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047558 Aug 29 22:55:12.332284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1006/2007] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:12.576461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:12.577856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:12.585000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:12.585477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:12.585912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:12.586600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:12.587052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:12.587473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:12.651855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:12.661627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bf9d8914-697d-4782-a3b1-1fe53f933af6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089487 Aug 29 22:55:12.662193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1002/2008] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:12 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:13.344620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-502d0112-572d-4354-a477-fa9c30292d64 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:13.346766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-502d0112-572d-4354-a477-fa9c30292d64 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:13.353687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-502d0112-572d-4354-a477-fa9c30292d64 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:13.354169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-502d0112-572d-4354-a477-fa9c30292d64 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:13.354600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-502d0112-572d-4354-a477-fa9c30292d64 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:13.355294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-502d0112-572d-4354-a477-fa9c30292d64 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:13.355747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-502d0112-572d-4354-a477-fa9c30292d64 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:13.356201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-502d0112-572d-4354-a477-fa9c30292d64 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:13.388058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-502d0112-572d-4354-a477-fa9c30292d64 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047883 Aug 29 22:55:13.388687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1007/2009] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:13.682277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:13.682878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:13.690667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:13.691179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:13.691612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:13.692336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:13.692793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:13.693212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:13.757462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:13.766308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e562ffac-2a50-408d-83f8-8d7d84f9b5e0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087941 Aug 29 22:55:13.766876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1003/2010] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:13 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:14.400647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b7afaa06-fa9d-4453-8640-10b22205a55a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:14.402884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b7afaa06-fa9d-4453-8640-10b22205a55a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:14.410933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7afaa06-fa9d-4453-8640-10b22205a55a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:14.411416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7afaa06-fa9d-4453-8640-10b22205a55a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:14.411846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7afaa06-fa9d-4453-8640-10b22205a55a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:14.412580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7afaa06-fa9d-4453-8640-10b22205a55a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:14.413030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7afaa06-fa9d-4453-8640-10b22205a55a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:14.413454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7afaa06-fa9d-4453-8640-10b22205a55a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:14.445648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b7afaa06-fa9d-4453-8640-10b22205a55a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049028 Aug 29 22:55:14.446212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1008/2011] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:14.787521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:14.788337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:14.794760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:14.795233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:14.796413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:14.797458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:14.797917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:14.798363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:14.866640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:14.876902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ad9e04af-22bb-4681-a4fa-33b1328b132f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093530 Aug 29 22:55:14.877540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1004/2012] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:14 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:15.058129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:15.058129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:15.064285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.064770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.065260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.065961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.066402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.066818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.458837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cf45fd38-ce0c-4dee-a779-1ed505386465 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:15.461070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cf45fd38-ce0c-4dee-a779-1ed505386465 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:15.468233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf45fd38-ce0c-4dee-a779-1ed505386465 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.468750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf45fd38-ce0c-4dee-a779-1ed505386465 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.469157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf45fd38-ce0c-4dee-a779-1ed505386465 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.469862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf45fd38-ce0c-4dee-a779-1ed505386465 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.470316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf45fd38-ce0c-4dee-a779-1ed505386465 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.470738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf45fd38-ce0c-4dee-a779-1ed505386465 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.473357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:15.501621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cf45fd38-ce0c-4dee-a779-1ed505386465 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046716 Aug 29 22:55:15.502204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1005/2013] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:55:15.898976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:15.899660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:15.906853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.907337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.907774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.908535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.908989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.909412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.974601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:15.983596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5bdde179-bd7d-4c6a-a725-d5b8f769e2be tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087914 Aug 29 22:55:15.984610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1006/2014] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:15 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:16.514646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-29a644d4-63f9-40d5-a07c-0bae76e13d67 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:16.516922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-29a644d4-63f9-40d5-a07c-0bae76e13d67 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:16.523289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29a644d4-63f9-40d5-a07c-0bae76e13d67 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:16.523614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29a644d4-63f9-40d5-a07c-0bae76e13d67 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:16.524043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29a644d4-63f9-40d5-a07c-0bae76e13d67 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:16.524776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29a644d4-63f9-40d5-a07c-0bae76e13d67 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:16.525226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29a644d4-63f9-40d5-a07c-0bae76e13d67 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:16.525647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29a644d4-63f9-40d5-a07c-0bae76e13d67 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:16.557469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-29a644d4-63f9-40d5-a07c-0bae76e13d67 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 Aug 29 22:55:16.562749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1007/2015] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:55:17.004960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:17.007044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:17.012017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:17.012528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:17.012963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:17.013647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:17.014096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:17.014517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:17.077561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:17.086336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3a7090a6-5771-4efe-8b41-c3afc3e5ae4f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085228 Aug 29 22:55:17.086906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1008/2016] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:16 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:17.570867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8079f101-a047-4147-a1bf-8491b854273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:17.573062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8079f101-a047-4147-a1bf-8491b854273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:17.580445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8079f101-a047-4147-a1bf-8491b854273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:17.585719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8079f101-a047-4147-a1bf-8491b854273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:17.585719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8079f101-a047-4147-a1bf-8491b854273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:17.585719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8079f101-a047-4147-a1bf-8491b854273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:17.585719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8079f101-a047-4147-a1bf-8491b854273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:17.586114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8079f101-a047-4147-a1bf-8491b854273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:17.612749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8079f101-a047-4147-a1bf-8491b854273b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 Aug 29 22:55:17.613324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1009/2017] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:55:18.107677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:18.108424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:18.111705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=86 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:18.116468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:18.116951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:18.117385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:18.118079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:18.118533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:18.118961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:18.183945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:18.192542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0c32667d-79af-4cef-9909-be5541b6cdda tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088691 Aug 29 22:55:18.193124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1010/2018] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:18 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:18.625529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-41e58f61-fb0d-4fc5-b9c2-291cd5ccd2b4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:18.627719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-41e58f61-fb0d-4fc5-b9c2-291cd5ccd2b4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:18.633797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41e58f61-fb0d-4fc5-b9c2-291cd5ccd2b4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:18.634278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41e58f61-fb0d-4fc5-b9c2-291cd5ccd2b4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:18.634707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41e58f61-fb0d-4fc5-b9c2-291cd5ccd2b4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:18.635400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41e58f61-fb0d-4fc5-b9c2-291cd5ccd2b4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:18.635853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41e58f61-fb0d-4fc5-b9c2-291cd5ccd2b4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:18.636312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41e58f61-fb0d-4fc5-b9c2-291cd5ccd2b4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:18.666937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-41e58f61-fb0d-4fc5-b9c2-291cd5ccd2b4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045433 Aug 29 22:55:18.667498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1011/2019] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:55:19.213975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:19.214617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:19.221747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:19.222231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:19.222665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:19.223358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:19.223811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:19.224270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:19.286102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:19.293868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2504c6bd-c33f-44d2-b93b-7fb8ca833af7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.083843 Aug 29 22:55:19.294439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1012/2020] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:19 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:19.679922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e1cab812-25a5-4e6c-bf21-b17ff9f2c77c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:19.682107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e1cab812-25a5-4e6c-bf21-b17ff9f2c77c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:19.688872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1cab812-25a5-4e6c-bf21-b17ff9f2c77c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:19.689348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1cab812-25a5-4e6c-bf21-b17ff9f2c77c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:19.689779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1cab812-25a5-4e6c-bf21-b17ff9f2c77c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:19.690470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1cab812-25a5-4e6c-bf21-b17ff9f2c77c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:19.691044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1cab812-25a5-4e6c-bf21-b17ff9f2c77c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:19.691466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1cab812-25a5-4e6c-bf21-b17ff9f2c77c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:19.723795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e1cab812-25a5-4e6c-bf21-b17ff9f2c77c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047804 Aug 29 22:55:19.724386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1013/2021] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 22:55:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:55:20.315400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:20.316131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:20.322619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:20.323143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:20.323582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:20.324319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:20.324780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:20.325207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:20.388911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:20.397479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ac5541f2-42ba-4c64-9828-cd99c8751599 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086422 Aug 29 22:55:20.398095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1014/2022] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:20 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:20.737264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-42970219-6219-42e4-a55d-7545e673ae0d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:20.739479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-42970219-6219-42e4-a55d-7545e673ae0d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:20.745820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-42970219-6219-42e4-a55d-7545e673ae0d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:20.746257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-42970219-6219-42e4-a55d-7545e673ae0d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:20.746698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-42970219-6219-42e4-a55d-7545e673ae0d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:20.747411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-42970219-6219-42e4-a55d-7545e673ae0d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:20.748119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-42970219-6219-42e4-a55d-7545e673ae0d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:20.748340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-42970219-6219-42e4-a55d-7545e673ae0d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:20.849830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-42970219-6219-42e4-a55d-7545e673ae0d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/action" status: 200 len: 41397 microversion: 2.1 time: 0.117204 Aug 29 22:55:20.850780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1015/2023] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 22:55:20 2022] POST /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922/action => generated 41397 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:55:21.122875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:21.123449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:21.131111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:21.131588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:21.132022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:21.132744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:21.133191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:21.133610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:21.160265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:55:21.263551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.compute.api [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Instance is already in deleting state, ignoring this request Aug 29 22:55:21.264419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-118dde26-e83c-4942-bebd-38dd8a676131 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 204 len: 0 microversion: 2.1 time: 0.145946 Aug 29 22:55:21.265077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1016/2024] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 22:55:21 2022] DELETE /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:55:21.273739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:21.274343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:21.280814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:21.281215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:21.281733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:21.282337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:21.282784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:21.283206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:21.347139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:21.354920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-93a5ded3-2a8e-4f95-9c92-4eb2f808138c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084872 Aug 29 22:55:21.355482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1017/2025] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:21 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:22.375969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:22.376707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:22.383083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:22.383568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:22.384008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:22.384735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:22.385192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:22.385622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:22.451928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:22.460810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-196211bc-275b-4cdd-a629-de0d38c5776f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089039 Aug 29 22:55:22.461391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1018/2026] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:22 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:23.482443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:23.483104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:23.490162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:23.490643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:23.491080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:23.491773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:23.492257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:23.492682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:23.558278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:23.566458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7637f71b-a1ef-4c27-af76-f50a5f7d1353 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087903 Aug 29 22:55:23.567024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1019/2027] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:23 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:23.823247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lazy-loading 'services' on Instance uuid 97ddee20-0f21-4105-80d6-d388c1146f7d {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:24.588641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:24.589301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:24.596535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:24.597027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:24.597467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:24.598163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:24.598610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:24.599030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:24.670097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:24.672956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:24.679143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a21da34a-81d9-47cf-8058-20e165df8635 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094309 Aug 29 22:55:24.679716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1020/2028] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:24 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:25.060671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=7 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:25.701354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:25.702201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:25.709816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:25.710294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:25.710726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:25.711420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:25.711865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:25.712312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:25.775701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:25.783668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8fc7f068-fc49-4059-a54f-6aeca89eff2e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086218 Aug 29 22:55:25.784250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1021/2029] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:26.804471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:26.805122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:26.811552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:26.812282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:26.812858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:26.813565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:26.814020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:26.814443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:26.879644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:26.887459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f4029f2c-ffff-4fa8-be4a-14e35a3a66c4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086978 Aug 29 22:55:26.888015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1022/2030] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:27.909338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:27.910038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:27.916633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:27.917113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:27.917541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:27.918234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:27.918679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:27.919097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:27.982950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:27.991471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-09147fd2-7c78-4261-bfa9-aafb1483cf34 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086673 Aug 29 22:55:27.992047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1023/2031] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:27 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:29.012568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:29.013266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:29.019855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:29.021917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:29.021917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:29.021917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:29.021917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:29.022313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:29.085277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:29.093083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b14f0907-4551-4b06-96a2-2be29c9f6200 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084340 Aug 29 22:55:29.093917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1024/2032] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:29 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:30.115006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:30.115685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:30.122240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:30.122727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:30.123165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:30.123870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:30.125039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:30.125662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:30.189261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:30.197036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1ffc038a-fa78-440b-8271-131a85417851 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085900 Aug 29 22:55:30.197605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1025/2033] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:30 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:31.219224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:31.219899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:31.226449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:31.226940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:31.227380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:31.228080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:31.228575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:31.230139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:31.296966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:31.304791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-17f7001d-8d4d-4692-bdde-3bb76cf8d8bf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089674 Aug 29 22:55:31.305392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1026/2034] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:31 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:32.326392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:32.327413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:32.333798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:32.334279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:32.334708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:32.335395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:32.335844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:32.336303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:32.397918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:32.414867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-711c0b3f-14c1-4eb4-8efd-f7f0246e0e64 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092277 Aug 29 22:55:32.415461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1027/2035] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:32 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:33.439962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:33.440709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:33.447051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:33.447525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:33.447953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:33.448662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:33.449108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:33.449545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:33.529688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:33.537226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f5a10a58-1229-4408-85fe-c14102d40ed8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.101608 Aug 29 22:55:33.537800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1028/2036] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:33 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:33.827732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=66 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:34.558440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:34.559041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:34.566589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:34.567073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:34.567504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:34.568231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:34.568681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:34.569102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:34.633030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:34.645610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5bfdc1d5-c267-4b33-b813-f943f1ced063 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089335 Aug 29 22:55:34.646194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1029/2037] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:34 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:35.667078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:35.667759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:35.674812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:35.675299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:35.675740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:35.676467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:35.676930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:35.677357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:35.741319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:35.749823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7547c54c-288c-4249-ab93-ab533d6efbfd tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085953 Aug 29 22:55:35.750396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1030/2038] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:35 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:36.771661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:36.772389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:36.774228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:55:36.774374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 22:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 (ip 10.222.0.59) !!! Aug 29 22:55:36.781435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:36.781913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:36.782343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:36.783037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:36.783480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:36.783951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:36.847683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:36.855526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3d18ca98-29da-49a6-9672-903c42dccc1a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087720 Aug 29 22:55:36.856092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1031/2039] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:36 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:37.876508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:37.877208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:37.883489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:37.883967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:37.884427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:37.885113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:37.885561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:37.885979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:37.950334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:37.959030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f1eb1d0a-442d-47b9-aef1-1f9724efe404 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086632 Aug 29 22:55:37.959596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1032/2040] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:37 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:38.980553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:38.981219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:38.988502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:38.988989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:38.989433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:38.990128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:38.990585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:38.991004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:39.053062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:39.060941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3bd2faa2-1076-4dd2-b038-30b68fdd321c tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084467 Aug 29 22:55:39.061642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1033/2041] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:38 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:40.082357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:40.083073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:40.089744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:40.090243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:40.090723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:40.091424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:40.091880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:40.092347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:40.158957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:40.166941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b709d274-e8dc-468e-b543-dab6ea24affb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088526 Aug 29 22:55:40.167507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1034/2042] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:40 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:41.188883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:41.189528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:41.196091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:41.196638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:41.197077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:41.197785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:41.198264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:41.198694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:41.264101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:41.272962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a17d0275-4473-4304-b88e-459590778c4a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088300 Aug 29 22:55:41.277881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1035/2043] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:41 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:42.294588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:42.295229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:42.301912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:42.302402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:42.302876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:42.303622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:42.304160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:42.304514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:42.367577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:42.376115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ef50bb6f-2ab2-42cf-a9f9-c6803731eada tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085480 Aug 29 22:55:42.376889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1036/2044] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:42 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:43.397048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:43.397732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:43.404203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:43.404692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:43.405769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:43.406453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:43.406904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:43.407323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:43.413632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:55:43.418267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 22:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 (ip 10.222.0.59) !!! Aug 29 22:55:43.425446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:43.477171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:43.486152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e6ee4532-c86b-4c01-b9be-3f26aedc4043 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092976 Aug 29 22:55:43.486722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1037/2045] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:43 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:44.506934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:44.507635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:44.514756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:44.515468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:44.515905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:44.516647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:44.517109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:44.517533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:44.580634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:44.588636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9f574e4b-f95e-498e-a62f-fcc9e05c52ad tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085486 Aug 29 22:55:44.589213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1038/2046] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:44 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:45.610859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:45.611638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:45.618034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:45.618521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:45.618961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:45.619682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:45.620177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:45.620597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:45.685553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:45.693669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-31e2ecf6-42a6-4d38-ac12-22b15c0b84c8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087372 Aug 29 22:55:45.694235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1039/2047] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:45 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:46.715324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:46.716009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:46.718053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:55:46.718202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 22:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 (ip 10.222.0.59) !!! Aug 29 22:55:46.726379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:46.726880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:46.727323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:46.728033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:46.728524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:46.728949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:46.793635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:46.802560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4ba72be9-d761-48ec-888b-7711e065109d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091143 Aug 29 22:55:46.803180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1040/2048] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:46 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:47.645628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:55:47.646195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 22:55:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 (ip 10.222.0.59) !!! Aug 29 22:55:47.824476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:47.825158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:47.832271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:47.832774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:47.833180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:47.833880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:47.834326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:47.834747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:47.899271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:47.907562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4f625050-e027-4d4c-be96-0cb2aa6d1421 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.087144 Aug 29 22:55:47.908208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1041/2049] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:47 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:48.930038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:48.930676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:48.936778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=64 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:48.938716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:48.939210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:48.939671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:48.940409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:48.940864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:48.941284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:49.009333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:49.018555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cd08e709-784d-4061-afc9-14bd07084562 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092829 Aug 29 22:55:49.018903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1042/2050] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:48 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:50.040246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:50.041026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:50.047762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:50.048292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:50.048733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:50.049440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:50.049897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:50.050336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:50.113272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:50.121508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b76c31bf-2edf-4a10-9659-3ba510d79edf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085158 Aug 29 22:55:50.122075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1043/2051] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:50 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:51.141358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:51.142036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:51.148466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:51.148957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:51.149403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:51.150098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:51.150562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:51.150987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:51.213081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:51.221564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a704d862-8cee-4e82-8c8f-394d28b953f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084126 Aug 29 22:55:51.225721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1044/2052] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:51 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:52.242897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:52.243592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:52.250793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:52.251280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:52.251722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:52.252443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:52.252900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:52.253329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:52.317148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:52.324857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8a38b8ec-6190-4e6f-ace9-907ab6f854b2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085858 Aug 29 22:55:52.325425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1045/2053] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:52 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:53.347016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:53.347704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:53.353600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:53.354091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:53.354527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:53.355231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:53.355684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:53.356102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:53.427867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:53.436782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4a55f905-e2e0-47b5-b346-3911ca399b96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094269 Aug 29 22:55:53.437371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1046/2054] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:53 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:54.458393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:54.459100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:54.465411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:54.465889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:54.466319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:54.467436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:54.468076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:54.468530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:54.531759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:54.539597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7da81b64-b339-4593-ba44-1b7422949378 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085047 Aug 29 22:55:54.540178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1047/2055] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:54 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:55.562159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:55.562852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:55.569168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:55.569648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:55.570074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:55.570757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:55.571201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:55.571624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:55.633163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:55.641685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8479f0b2-285a-49ba-8bd9-532f1da04726 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084077 Aug 29 22:55:55.642248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1048/2056] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:55 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:56.736879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:56.737577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:56.744817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:56.745310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:56.745742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:56.746458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:56.746907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:56.747324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:56.813058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:56.820675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a6f507b9-bc03-4938-bbb3-44253ff70f99 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.161566 Aug 29 22:55:56.821240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1049/2057] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:56 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:57.842645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:57.843337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:57.849848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:57.850342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:57.850805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:57.851493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:57.851953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:57.852407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:57.920035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:57.928813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8d0f48cc-7d16-4288-a695-5f48c8c27a46 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090178 Aug 29 22:55:57.929389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1050/2058] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:57 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:58.950862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:58.952374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:58.958868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:58.959343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:58.959774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:58.960492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:58.960940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:58.961366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.034416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:59.042761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-da4fd3fd-b526-4b26-99b0-9781fce6eb32 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.095833 Aug 29 22:55:59.043346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1051/2059] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:58 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:00.065297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:00.065982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:00.073057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:00.073943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:00.074743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:00.076922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:00.077650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:00.078165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:00.145404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:00.151477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4eb2eb7d-d6f8-4f5c-b03b-6ee401e45dbc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090767 Aug 29 22:56:00.152043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1052/2060] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:00 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:01.174003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:01.174678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:01.181000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:01.184286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:01.184286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:01.184286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:01.184286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:01.184878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:01.250095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:01.258100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f389e592-273e-4216-9f0a-82c49cc3b19a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088995 Aug 29 22:56:01.258853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1053/2061] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:01 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:02.278441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:02.279872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:02.286118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:02.286594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:02.287022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:02.287714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:02.288179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:02.288599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:02.291161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:02.354363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:02.363049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a0f9a5cd-e3cc-4447-a5c9-9258afe09a94 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088413 Aug 29 22:56:02.363622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1054/2062] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:02 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:03.382986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:03.383719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:03.391349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:03.391835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:03.392311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.393010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:03.393467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:03.393890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.457414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:03.465300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-47bac9a7-07f0-4c22-bc5f-b3adb7c65c20 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086186 Aug 29 22:56:03.465885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1055/2063] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:03 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:04.486364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:04.487061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:04.493657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:04.494140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:04.494579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:04.495271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:04.495729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:04.496169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:04.557753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:04.566159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5043b3a1-e140-42d3-8e5a-537e76bd6072 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.083942 Aug 29 22:56:04.566731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1056/2064] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:04 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:05.587980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:05.588734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:05.595663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:05.596173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:05.596609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:05.597309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:05.597775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:05.598190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:05.662070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:05.670885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-581fc227-1007-4fec-a4cf-a2ed612704ba tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086685 Aug 29 22:56:05.671494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1057/2065] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:05 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:06.692696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:06.693396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:06.699249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:06.699729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:06.700387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:06.702832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:06.703350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:06.703783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:06.773326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:06.781885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ef307d03-7563-4d7d-a9ad-13b44c96868f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093573 Aug 29 22:56:06.782464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1058/2066] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:06 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:07.816568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:07.817371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:07.824000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:07.824521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:07.824949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:07.825685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:07.826349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:07.826939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:08.038924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:08.047575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a5cfbff5-2915-49d8-bc85-3a0d1b5dfa01 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.234985 Aug 29 22:56:08.048185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1059/2067] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:07 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:09.069004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:09.069673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:09.076803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:09.077290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:09.077721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:09.078409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:09.078862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:09.079280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:09.143662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:09.151477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-260de401-15b6-47e5-ae0b-188e655d89e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086334 Aug 29 22:56:09.152043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1060/2068] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:09 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:10.173458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:10.174105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:10.180446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:10.180925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:10.181360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:10.182230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:10.182620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:10.183043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:10.249966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:10.258347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a1d92ddc-07f8-4cd9-84e1-b191b71875f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.089759 Aug 29 22:56:10.258929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1061/2069] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:10 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:11.280556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:11.281223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:11.287801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:11.288328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:11.288763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:11.289446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:11.289893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:11.290308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:11.358375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:11.366939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-960fe119-9d76-4761-90ac-cd97b4b85222 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090872 Aug 29 22:56:11.370706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1062/2070] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:11 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:12.390721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:12.390721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:12.396618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:12.397097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:12.397681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:12.398210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:12.398654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:12.399071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:12.463942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:12.473082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bf2467e2-419d-4d02-b578-ab9c05d33f03 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088669 Aug 29 22:56:12.473697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1063/2071] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:12 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:13.493819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:13.494524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:13.501960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:13.502450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:13.502918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:13.503643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:13.504077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:13.504528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:13.569322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:13.578328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d9596949-53b6-4cab-bd79-5d6311edb6e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.088379 Aug 29 22:56:13.578904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1064/2072] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:13 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:14.599553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:14.600310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:14.607882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:14.608597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:14.609041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:14.609748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:14.610209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:14.610633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:14.677567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:14.686640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-997791c9-24f5-40f3-9b51-9abb47f2c706 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.090798 Aug 29 22:56:14.687248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1065/2073] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:14 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:56:15.236673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:15.237172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:15.243212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:15.243692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:15.244127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:15.244848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:15.245304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:15.245731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:25.240593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=49 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:25.266972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=75 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:15.312168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-423f6163-a546-4921-8e83-afd3962394e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5" status: 202 len: 0 microversion: 2.1 time: 120.258657 Aug 29 22:57:15.313448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1009/2074] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:55:15 2022] DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 => generated 0 bytes in 120261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:57:15.320955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:15.321672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:15.341848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:15.342635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:15.343180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:15.343946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:15.344462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:15.345951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:15.420008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:15.429663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8e865238-1c5b-40c2-9e26-85e285875712 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.114827 Aug 29 22:57:15.430399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1010/2075] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:15 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:15.438298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:15.438805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:15.445050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:15.445551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:15.446186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:15.446831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:15.447115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:15.447533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:15.543950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lazy-loading 'services' on Instance uuid 97ddee20-0f21-4105-80d6-d388c1146f7d {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:57:24.069587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lazy-loading 'services' on Instance uuid 97ddee20-0f21-4105-80d6-d388c1146f7d {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:57:24.097890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d936b1e7-3d11-4ce2-8b80-c5bef8b2ef64) Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Request method failure captured: Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 HTTP/1.1 Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUGucquLiToEd8Q-5eJyuXwvCos8kRq5YEubkON8o9nDDaSeMjb6EzGTPGcjqKJUrgoPFG-4TXP3xbcX-YDOmH0ya0FFzFPY-fY6v270tmjKTDaYLWomoQ8c1RET9cn-IrMibGbdWZvXJIM0GhBSkS3T8f3nROkkNVfyzuPyESAHUdk Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:57:24.100823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2c0dcefe769247eaa49da038e336bc8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 484c09f238bd4b0d91b6aeaee913f7d5 Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:57:24.102410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d936b1e7-3d11-4ce2-8b80-c5bef8b2ef64) Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'server_id': '97ddee20-0f21-4105-80d6-d388c1146f7d', 'id': '8857016a-8588-49bb-a41e-68b1fa5080d5'} Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 29 22:57:24.103346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d936b1e7-3d11-4ce2-8b80-c5bef8b2ef64) Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:57:24.104603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d936b1e7-3d11-4ce2-8b80-c5bef8b2ef64) Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:24.105914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d936b1e7-3d11-4ce2-8b80-c5bef8b2ef64) Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:24.106985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d936b1e7-3d11-4ce2-8b80-c5bef8b2ef64) Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d936b1e7-3d11-4ce2-8b80-c5bef8b2ef64) Aug 29 22:57:24.109196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:24.110669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d936b1e7-3d11-4ce2-8b80-c5bef8b2ef64) {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:57:24.110669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c11c90d5-27d4-410a-a412-6cc17d3cebcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5" status: 400 len: 269 microversion: 2.1 time: 68.988659 Aug 29 22:57:24.110669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1066/2076] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:56:15 2022] DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 => generated 269 bytes in 68990 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:57:24.110669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:24.111228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:24.115131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:24.115610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:24.116046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:24.116765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:24.117212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:24.117629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:24.196383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:24.205326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-631e7a52-6435-465e-a76c-e2d601d07377 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.101370 Aug 29 22:57:24.205899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1067/2077] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:24 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:24.210807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:24.211299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:24.217657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:24.218147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:24.218591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:24.219296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:24.219746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:24.220198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:24.246175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:57:24.453108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4ab56823-afd7-4518-a451-d67ee693b53f tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "DELETE /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 204 len: 0 microversion: 2.1 time: 0.245697 Aug 29 22:57:24.453631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1068/2078] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 22:57:24 2022] DELETE /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:57:24.466452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:24.467147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:24.473331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:24.473814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:24.474259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:24.474948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:24.475401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:24.475812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:24.613978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:24.624491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d0ff6ad3-f950-490c-ab38-d5b5cc11f886 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1673 microversion: 2.1 time: 0.162347 Aug 29 22:57:24.625096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1069/2079] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:24 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:25.226873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:25.227550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:25.234285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:25.234780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:25.235223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:25.235932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:25.236419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:25.236852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:25.300003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:25.307851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-023eedfb-53bd-420e-b5a8-828c68fdeb78 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084836 Aug 29 22:57:25.308590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1070/2080] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:25.443128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=4 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:25.647177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:25.647869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:25.655608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:25.656217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:25.656752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:25.657523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:25.657984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:25.658404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:25.726569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:25.736676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-603572d5-e146-42f7-a726-e1f0e47f0947 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1606 microversion: 2.1 time: 0.093689 Aug 29 22:57:25.797318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1071/2081] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:25 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:26.044749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-b52b6115-2a5a-4c35-a0b3-0f5512efb318 req-1ae51594-8cc7-4dce-bd67-46bbb4df4c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e2d0b8-7d5e-49f6-80b8-64eada460383", "name": "network-vif-deleted", "tag": "b48581e0-9ac6-4388-9fa1-66cc4c5eb59a"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:26.055627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-b52b6115-2a5a-4c35-a0b3-0f5512efb318 req-1ae51594-8cc7-4dce-bd67-46bbb4df4c4f service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:26.056675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-b52b6115-2a5a-4c35-a0b3-0f5512efb318 req-1ae51594-8cc7-4dce-bd67-46bbb4df4c4f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:26.056919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-b52b6115-2a5a-4c35-a0b3-0f5512efb318 req-1ae51594-8cc7-4dce-bd67-46bbb4df4c4f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:26.069477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-b52b6115-2a5a-4c35-a0b3-0f5512efb318 req-1ae51594-8cc7-4dce-bd67-46bbb4df4c4f service nova] Creating event network-vif-deleted:b48581e0-9ac6-4388-9fa1-66cc4c5eb59a for instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 on hv-cinder-85426 Aug 29 22:57:26.075752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-b52b6115-2a5a-4c35-a0b3-0f5512efb318 req-1ae51594-8cc7-4dce-bd67-46bbb4df4c4f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169118 Aug 29 22:57:26.079974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1072/2082] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 22:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:57:26.330391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:26.331089 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:26.337926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:26.338424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:26.338952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:26.340196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:26.340908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:26.341349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:26.408934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:26.417189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0eb31856-0f05-40ab-8015-64f48a9f9ac3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091082 Aug 29 22:57:26.417776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1073/2083] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:26.766434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:26.767082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:26.774068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:26.774983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:26.774983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:26.775674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:26.776128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:26.776583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:26.813978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:26.814463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:26.814895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:26.815364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lazy-loading 'fault' on Instance uuid 19e2d0b8-7d5e-49f6-80b8-64eada460383 {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:57:26.873927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43cdaa09925c4b00be3b45cea4fd40b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7ab727f89e4fcb9933c2098b4fb501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:26.881906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bf7646d1-faff-4eed-96f3-ec3ae9fb54f8 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 200 len: 1326 microversion: 2.1 time: 0.119417 Aug 29 22:57:26.882479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1074/2084] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:26 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:27.439753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:27.440496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:27.446601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:27.447091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:27.447530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:27.448260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:27.448715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:27.449539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:27.512484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:27.520224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f3f1640a-a679-4c07-b645-3f68735aa645 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084530 Aug 29 22:57:27.520786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1075/2085] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:27 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:27.904301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:27.904915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:27.911504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:27.911993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:27.912490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:27.913196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:27.913654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:27.914144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:27.929545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] HTTP exception thrown: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Request method failure captured: Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 HTTP/1.1 Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEuuOn3fAMm-vmkfkzgy3YqCQiJSnWcAQ32q5zqpLHxaYYBd5Pnw3CWZTh9sU8mZ0Xq2svzUF921MogkriqHtKTylN0iZrPnpWanq3EHkTNtOYYe96baQ5L80gFKXUb8NsN7wPFJ8z9aSZE0U63hawbzOCRdPr5RjUlJQfnal2FyL0 Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:57:27.931215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df7ab727f89e4fcb9933c2098b4fb501", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeTestJSON-127938805 Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeTestJSON-127938805-project Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 43cdaa09925c4b00be3b45cea4fd40b7 Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeTestJSON-127938805-project Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 22:57:27.932844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '19e2d0b8-7d5e-49f6-80b8-64eada460383'} Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:57:27.934669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 22:57:27.936223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:57:27.937671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Returning 404 to user: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:57:27.937671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-722d4025-03a3-4ddc-a60a-1b60de495b33 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 404 len: 111 microversion: 2.1 time: 0.033070 Aug 29 22:57:27.937671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1076/2086] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:27 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:57:27.941570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-89bf4b8f-3e97-4e53-bda9-14e2369930b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '.version_select at 0x7febd54894c0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:28.013655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-89bf4b8f-3e97-4e53-bda9-14e2369930b0 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645226916" status: 202 len: 0 microversion: 2.1 time: 0.075678 Aug 29 22:57:28.014407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1077/2087] 10.222.0.59 () {58 vars in 1218 bytes} [Mon Aug 29 22:57:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645226916 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:57:28.541404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:28.542049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:28.550934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:28.551431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:28.551872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:28.552618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:28.553105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:28.553540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:28.641110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:28.649350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d3c1f650-a4af-4685-aaa6-4ca5458bc070 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.111938 Aug 29 22:57:28.649969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1078/2088] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:28 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:29.670539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:29.671224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:29.677694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:29.678165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:29.678595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:29.679283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:29.679732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:29.680171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:29.742524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:29.751554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e67ee598-9b11-493a-b91b-3f39a797370f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085178 Aug 29 22:57:29.752117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1079/2089] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:29 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:30.772800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:30.773479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:30.780798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:30.781285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:30.781724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:30.782422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:30.782881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:30.783307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:30.845470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:30.853419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b557d321-117f-4716-bfa7-384b05e31d8d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084475 Aug 29 22:57:30.853982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1080/2090] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:30 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:31.874745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:31.875447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:31.881725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:31.882200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:31.882636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:31.883321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:31.883770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:31.884208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:31.947154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:31.955781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-424054ff-a868-4f92-8fef-161f954b34c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085376 Aug 29 22:57:31.956393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1081/2091] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:31 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:32.976536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:32.977421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:32.985112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:32.985658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:32.986224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:32.987039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:32.987597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:32.988109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:33.055455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:33.063978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-098e40bf-6311-4817-8237-a6f90c4d1cf7 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091435 Aug 29 22:57:33.064589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1082/2092] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:32 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:34.075137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:34.084841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:34.091229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:34.091991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:34.092534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:34.092981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:34.093684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:34.094137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:34.094564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:34.098819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:34.157128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:34.164932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7213bf77-fd60-4a77-87be-58ec824af5f0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.083920 Aug 29 22:57:34.165502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1083/2093] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:34 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:35.186966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:35.187653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:35.194457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:35.194947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:35.195387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:35.196090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:35.196571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:35.197000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:35.267357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:35.278361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4dc9f5a3-ac33-4790-84fe-dd12b59e8101 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.095791 Aug 29 22:57:35.278937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1084/2094] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:35 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:36.299305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:36.299949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:36.306371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:36.306841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:36.307277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:36.307972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:36.309006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:36.309447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:36.371902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:36.379865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-611c2bba-8bdb-43d3-bcb3-4af4cec7b389 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084899 Aug 29 22:57:36.380460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1085/2095] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:36 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:37.401522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:37.403542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:37.410500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:37.414285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:37.414285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:37.414285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:37.414285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:37.414807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:37.481214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:37.489171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-813d5d22-5ba8-44da-8fee-1a022485c844 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091815 Aug 29 22:57:37.489736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1086/2096] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:37 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:38.510648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:38.511952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:38.518476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:38.518896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:38.519336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:38.520029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:38.520515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:38.520940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:38.584613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:38.592792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c19e2303-bbfd-4263-9652-701be264e940 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.086049 Aug 29 22:57:38.593386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1087/2097] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:38 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:39.614865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:39.615764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:39.623149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:39.623651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:39.624058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:39.624810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:39.625255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:39.625672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:39.688350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:39.696469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7a048ca8-d0cb-402a-98a1-12d74cd651de tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.085642 Aug 29 22:57:39.697035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1088/2098] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:39 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:40.717666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:40.718375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:40.724892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:40.725370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:40.725798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:40.726509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:40.726940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:40.727390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:40.789619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:40.797893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b510c373-ca44-480e-bd60-28bfa8035499 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084301 Aug 29 22:57:40.798495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1089/2099] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:40 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:41.819256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:41.819930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:41.827123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:41.827612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:41.828053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:41.828792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:41.829244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:41.829665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:41.897229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:41.906491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-454b16ba-12e0-4940-b852-2379f617897d tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091275 Aug 29 22:57:41.907080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1090/2100] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:41 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:42.928212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:42.928892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:42.936874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:42.937371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:42.937812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:42.938520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:42.938983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:42.939412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:43.006336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:43.015387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ff653e3d-a8f1-4088-aed2-d6a6f94eb664 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.091004 Aug 29 22:57:43.016317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1091/2101] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:42 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:44.037085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:44.037737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:44.044714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:44.045210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:44.045650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:44.046351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:44.046810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:44.047243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:44.109143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:44.117024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4ad52675-6f9a-48ac-ad40-e1d34a4074da tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.084008 Aug 29 22:57:44.117674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1092/2102] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:44 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:45.139595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:45.140344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:45.147596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:45.148081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:45.148726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:45.149727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:45.150180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:45.150601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:45.220582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:45.229242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ae6e1115-aa5b-428c-8cb2-6f80bc19f7f3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094349 Aug 29 22:57:45.230643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1093/2103] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:45 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:46.252624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:46.253613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:46.255929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:46.262236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:46.262761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:46.263202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:46.263921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:46.264415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:46.264844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:46.338564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:46.352895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-209412de-77e7-4c87-82cb-19c3019475c9 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.104518 Aug 29 22:57:46.353961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1094/2104] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:46 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:47.390791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:47.391638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:47.399152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:47.399826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:47.400406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:47.401241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:47.402296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:47.402996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:47.475651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:47.485238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f9710ae0-d43d-46a2-b610-eed3eb8dcaf0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.098819 Aug 29 22:57:47.486029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1095/2105] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:47 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:48.513220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:48.514304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:48.523470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:48.524282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:48.524936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:48.525699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:48.526301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:48.526891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:48.621619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:48.631035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-703d1e1e-0d70-41af-9865-08a787068c96 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.125012 Aug 29 22:57:48.631636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1096/2106] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:48 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:49.654748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:49.655453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:49.662518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:49.663008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:49.663443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:49.664161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:49.664627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:49.665057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:49.744554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:49.755310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f793e288-c11e-4595-9530-ebe3c5bc027b tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.105378 Aug 29 22:57:49.755903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1097/2107] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:49 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:50.778057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:50.779186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:50.786813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:50.787299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:50.787738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:50.788490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:50.788953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:50.790146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:50.857894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:50.866338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-945dbfcf-3f17-4187-9d08-ca6c0c15f37e tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093203 Aug 29 22:57:50.867002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1098/2108] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:50 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:51.891408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:51.892544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:51.905106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:51.905842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:51.906581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:51.907637 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:51.908522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:51.909245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:51.981679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:51.986008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:51.991268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2783a058-7f43-41f4-ae9f-73b44e9f6c09 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.107630 Aug 29 22:57:51.991863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1099/2109] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:51 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:53.014443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:53.015222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:53.022413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:53.022915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:53.023396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:53.024172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:53.024568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:53.024986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:53.114161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:53.123801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b5d699c1-c160-4382-9069-d9d1707eb4fa tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.114027 Aug 29 22:57:53.124538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1100/2110] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:53 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:54.146356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:54.147122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:54.154387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:54.154869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:54.155295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:54.156004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:54.156493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:54.156916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:54.225077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:54.235089 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d0799e73-7bd9-4a24-8643-5d8e1f720acc tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.092472 Aug 29 22:57:54.235683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1101/2111] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:54 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:55.258244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:55.259289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:55.267482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:55.268020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:55.268538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:55.269299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:55.269797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:55.270274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:55.350121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:55.360744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-33ede945-96cd-4f28-90d2-d9e916858af3 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.106380 Aug 29 22:57:55.363066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1102/2112] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:55 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:56.389745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:56.390490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:56.397529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:56.398016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:56.398455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:56.399170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:56.399625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:56.400052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:56.473459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:56.482579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5f124072-cc30-4b1a-916c-aff2e009f77a tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.098613 Aug 29 22:57:56.483167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1103/2113] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:56 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:57.505538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:57.506348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:57.514030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:57.514521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:57.514955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:57.515672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:57.516131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:57.516585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:57.586548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:57.596723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-87f6bfce-2aa5-475d-86c8-bc6a8741b207 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094965 Aug 29 22:57:57.597398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1104/2114] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:57 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:58.619148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:58.620580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:58.628123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:58.628764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:58.629299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:58.630164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:58.630707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:58.631311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:58.706179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:58.721774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-86bbb164-0162-48cb-ad29-c4a6c3a08766 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.106157 Aug 29 22:57:58.722852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1105/2115] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:58 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:59.746210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:59.747015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:59.754936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:59.755486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:59.755968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:59.756864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:59.757381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:59.757876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:59.826518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:59.835560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-14f0b67d-0814-4bb7-9b78-a0bb610466f2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.093557 Aug 29 22:57:59.836333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1106/2116] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:59 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:00.861389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:00.862856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:00.871659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:00.872396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:00.873076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:00.874013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:00.874592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:00.875158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:00.963024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:00.972114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2ff4d155-e04a-4a74-94bb-4429f5cda4cf tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.115798 Aug 29 22:58:00.972756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1107/2117] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:00 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:01.996237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:01.996984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:02.003913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:02.004492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:02.004984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:02.005784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:02.006282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:02.006796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:02.089437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:02.098160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-10af0619-2972-4335-abf7-3f82d6796ad8 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.106174 Aug 29 22:58:02.098762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1108/2118] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:01 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:03.120825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:03.121664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:03.128876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:03.129475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:03.129881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:03.130616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:03.131079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:03.131510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:03.203190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:03.211867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3bc67769-f5c1-4abe-a786-a4bbe0fe2714 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.095782 Aug 29 22:58:03.212701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1109/2119] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:03 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:04.234903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:04.236081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:04.243287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:04.243831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:04.244418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:04.245196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:04.245770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:04.246185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:04.318456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:04.328385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ebf1870f-11e7-4c10-b3f3-73a8ffe3d337 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.097918 Aug 29 22:58:04.329203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1110/2120] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:04 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:05.352538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:05.353328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:05.361599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:05.362094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:05.362537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:05.363258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:05.363712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:05.364149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:05.440727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:05.450755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6bdb9ba6-2b5b-480c-aa5e-29afeddafcd6 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.102106 Aug 29 22:58:05.451362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1111/2121] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:05 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:06.473922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:06.474763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:06.482648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:06.483153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:06.483591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:06.484377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:06.484844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:06.485275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:06.555363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:06.564575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-25e786af-6135-440e-88b2-4a71aa55989f tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094521 Aug 29 22:58:06.565239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1112/2122] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:06 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:07.588167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:07.590131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:07.596450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:07.596938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:07.597374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:07.598100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:07.598553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:07.598968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:07.670387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:07.678671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4a541e15-61b2-4961-8774-6e419f5ab2d2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094895 Aug 29 22:58:07.679269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1113/2123] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:07 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:08.702216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:08.703008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:08.710166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:08.710671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:08.711111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:08.711835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:08.712345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:08.712779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:08.784717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:08.793997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-765987d8-e30c-4bea-94ad-f353421074cb tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.097354 Aug 29 22:58:08.794652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1114/2124] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:08 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:09.816353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:09.817182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:09.825026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:09.825524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:09.825966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:09.826690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:09.827152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:09.827581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:09.902089 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:09.911004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-614eee92-83ec-4346-9cac-455df5b36775 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.098726 Aug 29 22:58:09.911602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1115/2125] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:09 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:10.935680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:10.936477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:10.943988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:10.944600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:10.945074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:10.945963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:10.946528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:10.946998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:10.969285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:11.355661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:11.364382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c9cdea7d-c03a-4466-9623-1236d03518f4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.433496 Aug 29 22:58:11.365003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1116/2126] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:10 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:12.387594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:12.388485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:12.396557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:12.397179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:12.398443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:12.398443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:12.398981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:12.399453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:12.475044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:12.484517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-126d6257-a8b7-43b7-81c9-fd1b48e5cc85 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.101699 Aug 29 22:58:12.485299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1117/2127] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:12 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:13.507856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:13.508969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:13.516865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:13.517410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:13.518007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:13.518813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:13.519324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:13.519793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:13.589617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:13.598817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ec1a2b6f-9609-49dd-9c6e-a19d25e19783 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.094953 Aug 29 22:58:13.599518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1118/2128] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:13 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:14.622013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:14.622822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:14.629728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:14.630225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:14.630659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:14.631375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:14.631874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:14.632361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:14.703281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:14.712413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f21834ee-f643-45c9-8ea0-ae548cd689b0 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.095137 Aug 29 22:58:14.713126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1119/2129] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:14 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:15.234961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:15.235459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:15.242684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:15.243251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:15.243893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:15.245421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:15.245934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:15.246450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:25.240038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=53 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:25.268341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=24 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:03.425547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:59:03.426236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 22:59:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 (ip 10.222.0.59) !!! Aug 29 22:59:06.774398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:59:06.775382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 22:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 (ip 10.222.0.59) !!! Aug 29 22:59:07.656231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:59:07.656927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 22:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 (ip 10.222.0.59) !!! Aug 29 22:59:15.833602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a86cdcd5-a629-40e5-a81f-fd00360c25b6) Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Request method failure captured: Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 HTTP/1.1 Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUGucquLiToEd8Q-5eJyuXwvCos8kRq5YEubkON8o9nDDaSeMjb6EzGTPGcjqKJUrgoPFG-4TXP3xbcX-YDOmH0ya0FFzFPY-fY6v270tmjKTDaYLWomoQ8c1RET9cn-IrMibGbdWZvXJIM0GhBSkS3T8f3nROkkNVfyzuPyESAHUdk Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 22:59:15.836187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2c0dcefe769247eaa49da038e336bc8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 484c09f238bd4b0d91b6aeaee913f7d5 Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:59:15.841178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a86cdcd5-a629-40e5-a81f-fd00360c25b6) Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'server_id': '97ddee20-0f21-4105-80d6-d388c1146f7d', 'id': '8857016a-8588-49bb-a41e-68b1fa5080d5'} Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 29 22:59:15.843860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a86cdcd5-a629-40e5-a81f-fd00360c25b6) Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:59:15.847633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a86cdcd5-a629-40e5-a81f-fd00360c25b6) Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:15.853917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a86cdcd5-a629-40e5-a81f-fd00360c25b6) Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:59:15.856271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a86cdcd5-a629-40e5-a81f-fd00360c25b6) Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a86cdcd5-a629-40e5-a81f-fd00360c25b6) Aug 29 22:59:15.859173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:15.861979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a86cdcd5-a629-40e5-a81f-fd00360c25b6) {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:59:15.861979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a5af318d-d675-4c6f-9a4c-b967be160ed0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5" status: 400 len: 269 microversion: 2.1 time: 120.406881 Aug 29 22:59:15.861979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1011/2130] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:57:15 2022] DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 => generated 269 bytes in 120408 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:59:15.861979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:15.862670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:15.862670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:15.862670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:15.862670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:15.863431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:15.863431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:15.863431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:15.948836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:15.954622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-43d183a5-43d7-4240-bc56-1a0ecb605bed tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.114020 Aug 29 22:59:15.955602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1012/2131] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:15 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:15.964521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:15.965357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:15.974243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:15.974993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:15.975654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:15.976530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:15.977273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:15.977989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:16.574684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lazy-loading 'services' on Instance uuid 97ddee20-0f21-4105-80d6-d388c1146f7d {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:59:16.830735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lazy-loading 'services' on Instance uuid 97ddee20-0f21-4105-80d6-d388c1146f7d {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:59:23.958374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:59:23.959086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 22:59:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 (ip 10.222.0.59) !!! Aug 29 22:59:24.355777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0232da3-5e14-4239-b6c9-0b787a4720e9) Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Request method failure captured: Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 HTTP/1.1 Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUGucquLiToEd8Q-5eJyuXwvCos8kRq5YEubkON8o9nDDaSeMjb6EzGTPGcjqKJUrgoPFG-4TXP3xbcX-YDOmH0ya0FFzFPY-fY6v270tmjKTDaYLWomoQ8c1RET9cn-IrMibGbdWZvXJIM0GhBSkS3T8f3nROkkNVfyzuPyESAHUdk Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 22:59:24.359771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2c0dcefe769247eaa49da038e336bc8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 484c09f238bd4b0d91b6aeaee913f7d5 Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:59:24.362832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0232da3-5e14-4239-b6c9-0b787a4720e9) Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'server_id': '97ddee20-0f21-4105-80d6-d388c1146f7d', 'id': '8857016a-8588-49bb-a41e-68b1fa5080d5'} Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 29 22:59:24.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0232da3-5e14-4239-b6c9-0b787a4720e9) Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:59:24.365963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0232da3-5e14-4239-b6c9-0b787a4720e9) Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.368771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0232da3-5e14-4239-b6c9-0b787a4720e9) Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:59:24.370982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0232da3-5e14-4239-b6c9-0b787a4720e9) Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0232da3-5e14-4239-b6c9-0b787a4720e9) Aug 29 22:59:24.375978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.378568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0232da3-5e14-4239-b6c9-0b787a4720e9) {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:59:24.378568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-df1c2d2a-e356-425d-b901-7e4aa1fcf5af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5" status: 400 len: 269 microversion: 2.1 time: 69.132303 Aug 29 22:59:24.378568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1120/2132] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:58:15 2022] DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 => generated 269 bytes in 69134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 22:59:24.378568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:24.379168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:24.379749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:24.380289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:24.380740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:24.381480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:24.381951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:24.382389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:24.482465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:24.495141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e055891a-ef49-46f5-93e6-c043af263eb4 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1224 microversion: 2.1 time: 0.130459 Aug 29 22:59:24.495993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1121/2133] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:24 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:24.587697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f26b2506-09f7-4396-8095-acd7e7b2cd5b) Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Request method failure captured: Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 HTTP/1.1 Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUGucquLiToEd8Q-5eJyuXwvCos8kRq5YEubkON8o9nDDaSeMjb6EzGTPGcjqKJUrgoPFG-4TXP3xbcX-YDOmH0ya0FFzFPY-fY6v270tmjKTDaYLWomoQ8c1RET9cn-IrMibGbdWZvXJIM0GhBSkS3T8f3nROkkNVfyzuPyESAHUdk Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 22:59:24.591033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2c0dcefe769247eaa49da038e336bc8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2c0dcefe769247eaa49da038e336bc8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 2c0dcefe769247eaa49da038e336bc8a Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-942660605 Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 484c09f238bd4b0d91b6aeaee913f7d5 Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesSnapshotTestJSON-942660605-project Aug 29 22:59:24.593652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f26b2506-09f7-4396-8095-acd7e7b2cd5b) Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'server_id': '97ddee20-0f21-4105-80d6-d388c1146f7d', 'id': '8857016a-8588-49bb-a41e-68b1fa5080d5'} Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 29 22:59:24.595213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f26b2506-09f7-4396-8095-acd7e7b2cd5b) Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5192, in _detach_volume Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:59:24.597506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f26b2506-09f7-4396-8095-acd7e7b2cd5b) Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.599935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5214, in detach_volume Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f26b2506-09f7-4396-8095-acd7e7b2cd5b) Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:59:24.603017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f26b2506-09f7-4396-8095-acd7e7b2cd5b) Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f26b2506-09f7-4396-8095-acd7e7b2cd5b) Aug 29 22:59:24.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:24.607590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f26b2506-09f7-4396-8095-acd7e7b2cd5b) {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:59:24.607590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-63fbe19f-8c4e-463a-bbfd-144ab32e0fcb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5" status: 400 len: 269 microversion: 2.1 time: 8.635833 Aug 29 22:59:24.607590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1013/2134] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 22:59:15 2022] DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d/os-volume_attachments/8857016a-8588-49bb-a41e-68b1fa5080d5 => generated 269 bytes in 8638 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:59:25.518611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:25.519254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:25.527366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:25.530256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:25.530256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:25.530256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:25.530256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:25.530678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:25.563794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:25.564345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:25.564873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:25.565327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lazy-loading 'fault' on Instance uuid b697cf12-f552-4b39-89fe-062c61614073 {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:59:25.608831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21feac769b4b48508163f535cdedfbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42dbdfe1c064b2080b48f8d40a4638b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:25.616766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-86d3ca3f-c644-4e1d-afa1-5ef5bf4e44e2 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 200 len: 1183 microversion: 2.1 time: 0.102782 Aug 29 22:59:25.625953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1122/2135] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:25 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 1183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:26.637978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=4 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:26.642038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:26.642649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] [instance: b697cf12-f552-4b39-89fe-062c61614073] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:26.649807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:26.652131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:26.652131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:26.652131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:26.652131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:26.652761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:26.668001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] HTTP exception thrown: Instance b697cf12-f552-4b39-89fe-062c61614073 could not be found. Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Request method failure captured: Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 HTTP/1.1 Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUGWwCkxGvE8H08mazLFg-bfgumFW-5MLaE22BG7T-mlrFMrHwvTYnTyweKLrWPMfu93eepTyP22y9Uw3WZpUnbuQLcWrf_oQ9RWQ-AqPPCyFfL8b49LzBw70W-nSLuNl5A-SwIOKp_zedXXm7wzFfofaRIUYzlRW7em06vwXfvjZX0 Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: f42dbdfe1c064b2080b48f8d40a4638b Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-TestVolumeBootPattern-783858011 Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 22:59:26.669653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f42dbdfe1c064b2080b48f8d40a4638b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f42dbdfe1c064b2080b48f8d40a4638b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f42dbdfe1c064b2080b48f8d40a4638b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f42dbdfe1c064b2080b48f8d40a4638b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-TestVolumeBootPattern-783858011 Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: f42dbdfe1c064b2080b48f8d40a4638b Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-TestVolumeBootPattern-783858011 Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-TestVolumeBootPattern-783858011-project Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 21feac769b4b48508163f535cdedfbe5 Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-TestVolumeBootPattern-783858011-project Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance b697cf12-f552-4b39-89fe-062c61614073 could not be found. Aug 29 22:59:26.671455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': 'b697cf12-f552-4b39-89fe-062c61614073'} Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b697cf12-f552-4b39-89fe-062c61614073 could not be found. Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:59:26.672495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b697cf12-f552-4b39-89fe-062c61614073 could not be found. Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b697cf12-f552-4b39-89fe-062c61614073 could not be found. Aug 29 22:59:26.674025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 22:59:26.675795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Returning 404 to user: Instance b697cf12-f552-4b39-89fe-062c61614073 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:59:26.675795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aafe959e-b3ba-4967-bf27-8aa628e601ab tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073" status: 404 len: 111 microversion: 2.1 time: 0.034470 Aug 29 22:59:26.675795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1014/2136] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:26 2022] GET /compute/v2.1/servers/b697cf12-f552-4b39-89fe-062c61614073 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:01:14.197542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:14.198376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:14.200919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=6 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:14.201578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=18 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:14.202359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:01:14.202523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:01:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 (ip 10.222.0.59) !!! Aug 29 23:01:14.210649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:14.211134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:14.214922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:14.214922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:14.214922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:14.214922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:14.240086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:01:14.516267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1a9f40b7-dbd7-42f1-8b16-537b5ba90aba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 204 len: 0 microversion: 2.20 time: 0.326536 Aug 29 23:01:14.517150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1123/2137] 10.222.0.59 () {60 vars in 1280 bytes} [Mon Aug 29 23:01:14 2022] DELETE /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 23:01:14.524741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=16 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:14.530945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:14.532575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:14.538890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:14.539370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:14.539799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:14.540532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:14.540971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:14.541391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:14.992989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:15.001594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:15.003708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:15.005075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dccd16cc-a7da-400e-b69b-705bce7aa070 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1802 microversion: 2.20 time: 0.482913 Aug 29 23:01:15.005651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1015/2138] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1802 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:15.797982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:15.798580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:15.806001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:15.806629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:15.807177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:15.807903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:15.808516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:15.808949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:15.838854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:01:16.031000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:16.031000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:16.037791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:16.038546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:16.039112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:16.040110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:16.040597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:16.041080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:16.156533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eca32450-f6ca-485b-8781-f6cd2720e0bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 204 len: 0 microversion: 2.1 time: 0.374265 Aug 29 23:01:16.157263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1124/2139] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:01:15 2022] DELETE /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:01:16.168423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:16.168691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:16.169421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:16.178655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:16.179156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:16.179595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:16.180364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:16.180823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:16.181283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:16.185714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:16.188878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:16.191514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-287fa278-ba22-4ed3-aefa-2686ce57cf42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1734 microversion: 2.20 time: 0.165744 Aug 29 23:01:16.192684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1016/2140] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:01:16.350785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:16.362139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ffcb0c0b-13c7-43b4-9b1d-a5d12fc9dfde tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.199152 Aug 29 23:01:16.369239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1125/2141] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:16.427636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-86e58a53-9112-479c-9036-ed384c363df8 req-a00ae328-6274-4874-b669-c6b3a9617e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e568957-b28a-4d75-b458-3f8e95bb38d0", "name": "network-vif-deleted", "tag": "2eaca61c-9e3d-41ec-b39b-74fe4d54599d"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:01:16.440099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-86e58a53-9112-479c-9036-ed384c363df8 req-a00ae328-6274-4874-b669-c6b3a9617e04 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:16.441114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-86e58a53-9112-479c-9036-ed384c363df8 req-a00ae328-6274-4874-b669-c6b3a9617e04 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:16.441537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-86e58a53-9112-479c-9036-ed384c363df8 req-a00ae328-6274-4874-b669-c6b3a9617e04 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:16.453800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-86e58a53-9112-479c-9036-ed384c363df8 req-a00ae328-6274-4874-b669-c6b3a9617e04 service nova] Creating event network-vif-deleted:2eaca61c-9e3d-41ec-b39b-74fe4d54599d for instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 on hv-cinder-85426 Aug 29 23:01:16.460743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-86e58a53-9112-479c-9036-ed384c363df8 req-a00ae328-6274-4874-b669-c6b3a9617e04 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036907 Aug 29 23:01:16.464372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1017/2142] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:01:17.235639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:17.241130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:17.249734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:17.250339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:17.251099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:17.252358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:17.253482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:17.254291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:17.333876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:17.350103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:17.352983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:17.355275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-55897549-b4c3-4c97-b6d2-0e1f003f5c9c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.124907 Aug 29 23:01:17.356361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1126/2143] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:17.386434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:17.387204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:17.394822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:17.395646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:17.396174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:17.396856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:17.397318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:17.397746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:17.562770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:17.572953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b69a7a16-a5ee-43bf-81e5-ceab9eb11dc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.191442 Aug 29 23:01:17.573541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1018/2144] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:01:18.387023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:18.387617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:18.394903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:18.395451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:18.395886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:18.396610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:18.397061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:18.397475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:18.466062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:18.475730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:18.477210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:18.478354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e1fd0aae-57aa-44d8-b21e-cf648e33d034 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095266 Aug 29 23:01:18.478915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1127/2145] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:18.595760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:18.596433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:18.604032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:18.604558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:18.605008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:18.605712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:18.606164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:18.606585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:18.749384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:18.758636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f7f50081-1d8d-4a3c-9908-9e937a6649d7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167136 Aug 29 23:01:18.759217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1019/2146] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:01:19.501860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:19.502484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:19.511068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:19.511564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:19.512001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:19.512758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:19.513295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:19.513728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:19.579160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:19.588847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:19.590287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:19.591446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-76d08b50-69f3-48b9-b652-b9b4cc75e0be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093958 Aug 29 23:01:19.592003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1128/2147] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:19.781176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:19.781724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:19.788774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:19.789258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:19.789693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:19.790398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:19.790848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:19.791303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:19.927493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:19.935918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a7073536-8694-4d65-9320-8252d3c291bf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158819 Aug 29 23:01:19.936535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1020/2148] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:20.615379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:20.616192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:20.622551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:20.623029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:20.623460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:20.624162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:20.624624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:20.625045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:20.688892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:20.698804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:20.700293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:20.701449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-039242e4-46ba-4b99-b039-36e634e49dfd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090928 Aug 29 23:01:20.702106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1129/2149] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:01:20.961064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:20.961691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:20.968525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:20.969051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:20.969497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:20.970203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:20.970662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:20.971080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:21.108676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:21.118064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9c85a7f9-a5ed-4287-9f57-29f5286109f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160769 Aug 29 23:01:21.121257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1021/2150] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:21.723676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:21.724399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:21.730909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:21.731388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:21.731822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:21.732572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:21.733711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:21.734142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:21.800260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:21.809806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:21.811543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:21.812433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b0a7f1a5-b541-40bc-a431-33e5b2466bc9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092743 Aug 29 23:01:21.812992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1130/2151] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:22.141427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:22.142050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:22.148852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:22.149383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:22.149947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:22.150784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:22.151286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:22.151768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:22.297725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:22.307080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ec0a80b6-5e23-4036-9da2-9c5fa6a220a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170411 Aug 29 23:01:22.307674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1022/2152] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:22.837441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:22.838058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:22.844428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:22.844918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:22.845359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:22.846059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:22.846512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:22.846969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:22.910417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:22.919096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:22.920581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:22.921744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3f05d6ae-d2c7-45c4-80e0-e7ee7acdf706 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088267 Aug 29 23:01:22.922296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1131/2153] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:01:23.329945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:23.330556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:23.337065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:23.337546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:23.337983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:23.338671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:23.339124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:23.339550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:23.476873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:23.485641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a6f68cc5-1180-409b-aa45-b7f7da682dfb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159574 Aug 29 23:01:23.486233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1023/2154] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:23.946231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:23.946842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:23.953592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:23.954077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:23.954521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:23.955218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:23.955673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:23.956105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:24.018471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:24.027764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:24.029275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:24.030497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-72fc0594-a640-4a4d-a6b1-cd412a369164 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088544 Aug 29 23:01:24.031056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1132/2155] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:24.507615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:24.508198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:24.514736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:24.515214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:24.515648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:24.516369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:24.516822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:24.517244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:24.650385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:24.658783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1f21d869-19bf-4634-b610-c57a1e4383c7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155081 Aug 29 23:01:24.659973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1024/2156] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:25.054553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:25.055132 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:25.061694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:25.062109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:25.062537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:25.063253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:25.063699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:25.064120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:25.127318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:25.136632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:25.138093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:25.139214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b6b2ba3a-6484-4b2c-9735-400e2168719b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088669 Aug 29 23:01:25.139768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1133/2157] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:25.681454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:25.682062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:25.688507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:25.688984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:25.689415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:25.690103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:25.690699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:25.691416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:25.824397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:25.833692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-45ebe7ba-0583-47af-9179-2fcba7bc443c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.156059 Aug 29 23:01:25.834716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1025/2158] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:26.163018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:26.163627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:26.170221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:26.170704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:26.171144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:26.171837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:26.172327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:26.172751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:26.238816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:26.247719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:26.249219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:26.250385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-393372af-caae-4650-b788-9d6b46e415a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092282 Aug 29 23:01:26.251061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1134/2159] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:26.856570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:26.857185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:26.864473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:26.864949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:26.865386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:26.866079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:26.866525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:26.867617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:27.005482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:27.013848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0beddd49-af0e-4a64-a541-0826cd37869e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161153 Aug 29 23:01:27.014426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1026/2160] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:27.274140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:27.275845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:27.281267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:27.286887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:27.286887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:27.286887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:27.286887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:27.287411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:27.351649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:27.361273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:27.363965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:27.365200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6876f4dc-ed03-4733-8711-736b63cae7d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095209 Aug 29 23:01:27.366102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1135/2161] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:28.037250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:28.038101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:28.044764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:28.045244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:28.045680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:28.046384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:28.046838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:28.047262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:28.186380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:28.195752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d352c748-7803-4460-934c-59f3f751d322 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162998 Aug 29 23:01:28.196390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1027/2162] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:28.389451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:28.392406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:28.398449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:28.398955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:28.399391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:28.400095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:28.400580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:28.401015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:28.406414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:28.470319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:28.479787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:28.481382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:28.483668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3f8f3e53-c941-4c9f-b381-ff4737cad463 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097227 Aug 29 23:01:28.483668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1136/2163] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:29.217471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:29.218041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:29.226241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:29.226724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:29.227156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:29.227877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:29.228360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:29.228772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:29.393252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:29.408870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2e383abb-4dd0-44bd-9ce5-27dee6b6d56c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.195285 Aug 29 23:01:29.410044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1028/2164] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:29.506003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:29.506561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:29.512988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:29.513467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:29.513896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:29.514569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:29.515023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:29.515441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:29.577730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:29.587070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:29.588554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:29.589747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-83e87416-a043-4ec6-b2fa-282b6b06359a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088196 Aug 29 23:01:29.590304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1137/2165] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:30.431225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:30.431839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:30.438444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:30.438924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:30.439353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:30.440047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:30.440641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:30.441064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:30.593139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:30.602388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ea00f217-461f-4b21-8cc5-f101c4b877a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.175086 Aug 29 23:01:30.602978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1029/2166] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:30.613159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:30.613798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:30.620855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:30.621310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:30.621746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:30.622445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:30.622898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:30.623319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:30.687652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:30.697958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:30.699387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:30.700554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-62de0a4b-24a3-4b8e-b8d5-4e90990663ec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091307 Aug 29 23:01:30.701115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1138/2167] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:31.624034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:31.624697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:31.631494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:31.631969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:31.632443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:31.633171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:31.633624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:31.634051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:31.724912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:31.726074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:31.732576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:31.733148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:31.733647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:31.734409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:31.734864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:31.735365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:31.777482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:31.781349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-51f55a2c-b3f4-4a86-b555-80f233fad092 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161101 Aug 29 23:01:31.781961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1030/2168] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:31.802966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:31.811943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:31.813407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:31.814544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2ca467da-5dc0-47c9-8c97-14f82aeaa099 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094411 Aug 29 23:01:31.815108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1139/2169] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:01:32.804519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:32.805162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:32.811696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:32.812269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:32.812712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:32.813407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:32.813867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:32.814289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:32.837356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:32.838022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:32.844786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:32.845277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:32.845714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:32.846413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:32.846864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:32.847288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:32.917791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:32.928986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:32.930439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:32.935825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4c462e25-e9b8-4f87-9448-d896a3519a55 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102380 Aug 29 23:01:32.936747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1140/2170] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:32.961916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:32.970357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ecb5d328-9492-4f4d-b191-65fe05b72517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170381 Aug 29 23:01:32.970962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1031/2171] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:01:33.962458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:33.963061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:33.969523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:33.970004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:33.970431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:33.971113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:33.971558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:33.971971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:33.994627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:33.995429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:34.004819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:34.005976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:34.006496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:34.007376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:34.007966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:34.008675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:34.016998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:34.048801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:34.058665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:34.060093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:34.061291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f00dd236-27c1-4cf7-96df-c8de1b9fa3e6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.103418 Aug 29 23:01:34.061888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1141/2172] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:34.168224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:34.177707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d2c59d88-25ea-4bd8-94dc-d99383d09dd3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.187694 Aug 29 23:01:34.178575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1032/2173] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:01:35.086338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:35.086970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:35.093781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:35.094269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:35.094707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:35.095407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:35.095864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:35.096327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:35.159639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:35.168906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:35.170383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:35.171603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d290072d-1b26-4ad3-8618-34e9e00ee3a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089851 Aug 29 23:01:35.172212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1142/2174] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:35.202838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:35.203436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:35.210930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:35.211428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:35.211864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:35.212609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:35.213053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:35.213469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:35.349422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:35.358424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7ae51f4b-a26e-4145-b62f-4ceb917dbc25 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159160 Aug 29 23:01:35.359098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1033/2175] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:36.196473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:36.197070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:36.203513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:36.204000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:36.204471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:36.205164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:36.205618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:36.206058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:36.273143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:36.281841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:36.283281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:36.284452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-552a5a89-fa2b-47a3-afa1-5b4f7ec1cb84 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092527 Aug 29 23:01:36.285027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1143/2176] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:36.387878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:36.388703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:36.397217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:36.397735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:36.398316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:36.399137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:36.399592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:36.400070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:36.543359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:36.553163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-04224cac-32cd-454d-8662-5b331ae44223 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169309 Aug 29 23:01:36.553847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1034/2177] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:37.308359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:37.309037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:37.315561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:37.316043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:37.316524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:37.317191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:37.317896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:37.318311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:37.382516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:37.391731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:37.393244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:37.394402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6003c4c6-97e1-419f-9bc8-c536edb9933e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090296 Aug 29 23:01:37.394998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1144/2178] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:37.575072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:37.575635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:37.581996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:37.582472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:37.582898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:37.583587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:37.584035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:37.584483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:37.729700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:37.738235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-059e4b28-7115-4305-93b6-77ed7309568b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.166989 Aug 29 23:01:37.738881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1035/2179] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:38.419842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:38.420593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:38.427257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:38.427747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:38.428219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:38.429700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:38.430169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:38.430598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:38.505824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:38.516019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:38.517650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:38.518875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-76a30055-dc8d-4bec-b9af-2f9e875a2e52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.103114 Aug 29 23:01:38.519541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1145/2180] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:38.760691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:38.761223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:38.768233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:38.768717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:38.769147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:38.769832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:38.770276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:38.770692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:38.921242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:38.932806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4e28e1de-7676-4159-8aec-14f94542344f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.176378 Aug 29 23:01:38.933408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1036/2181] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:39.544112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:39.545061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:39.557979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:39.558660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:39.559253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:39.560356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:39.560907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:39.561491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:39.634941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:39.646129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:39.647628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:39.648901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-41152563-191b-4e77-8868-28d7b50ac477 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.109409 Aug 29 23:01:39.649606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1146/2182] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:39.958613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:39.959450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:39.966831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:39.967311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:39.967746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:39.968480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:39.968934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:39.969352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:40.114944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:40.123965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0fe1fcab-6b7e-49ef-a6ec-381e0ace7e49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169280 Aug 29 23:01:40.126847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1037/2183] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:40.678717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:40.679860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:40.691620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:40.692773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:40.693528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:40.695266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:40.696096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:40.696905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:40.768564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:40.778870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:40.780570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:40.781734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0d500e89-77c4-4534-8396-209c8764096a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.110287 Aug 29 23:01:40.782298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1147/2184] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:41.146425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:41.147060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:41.153739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:41.154207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:41.154640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:41.155332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:41.155784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:41.156228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:41.302312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:41.312170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c27865e6-fffb-4e32-8eb3-0d71aa91da5d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169613 Aug 29 23:01:41.312894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1038/2185] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:41.805588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:41.806371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:41.813187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:41.813674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:41.814105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:41.814807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:41.815302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:41.815724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:41.889261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:41.900006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:41.901546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:41.902714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8f6ce0cd-dc69-40c8-8991-c2efc0b8cfc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.101507 Aug 29 23:01:41.903286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1148/2186] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:42.334342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:42.335055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:42.341555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:42.342031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:42.342462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:42.343150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:42.343596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:42.344015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:42.493578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:42.502133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c0f9c438-3d2b-45ba-8c70-351d55db374d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171584 Aug 29 23:01:42.502740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1039/2187] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:42.926451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:42.927067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:42.934032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:42.934518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:42.934948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:42.935647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:42.936125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:42.936961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:43.002511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:43.013102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:43.014851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:43.016079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ce56d269-1057-42a4-8cc7-cac55071ef63 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093668 Aug 29 23:01:43.016677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1149/2188] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:01:43.525086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:43.525700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:43.532693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:43.533200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:43.533613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:43.534314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:43.534762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:43.535211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:43.671271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:43.679775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-90035d09-e332-4167-a2ae-d0ad0acb0711 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159142 Aug 29 23:01:43.680404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1040/2189] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:44.039013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:44.039618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:44.046270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:44.046750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:44.047183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:44.047868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:44.048353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:44.048776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:44.112565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:44.122448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:44.123909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:44.125078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-164e7544-0f3e-4d7a-889c-fa1f135c0b37 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090003 Aug 29 23:01:44.125639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1150/2190] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:44.702664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:44.703273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:44.705593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=55 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:44.710881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:44.711361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:44.711786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:44.712510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:44.712959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:44.713374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:44.860480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:44.869027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c7dcda51-e30c-4194-ab28-7f0117d78efe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170466 Aug 29 23:01:44.869611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1041/2191] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:45.149180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:45.149779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:45.152411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:45.157299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:45.157857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:45.158287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:45.159236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:45.159685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:45.160111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:45.232064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:45.242000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:45.243519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:45.244821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3f26542f-274a-4a71-be31-b7c7220acb2f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.100296 Aug 29 23:01:45.245391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1151/2192] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:45.891571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:45.892322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:45.899141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:45.899630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:45.900069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:45.900797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:45.901252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:45.901680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:46.036555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:46.055109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-171f8440-5fe2-4667-a6c6-9275f2f28f6c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167553 Aug 29 23:01:46.055709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1042/2193] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:46.269062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:46.269702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:46.276408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:46.276890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:46.277322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:46.278012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:46.278464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:46.278879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:46.345974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:46.347051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:46.353320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:46.354779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:46.355932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3c91d752-b4d3-44be-ae44-ba71de647a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090790 Aug 29 23:01:46.356562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1152/2194] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:47.076726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:47.077339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:47.083963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:47.084478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:47.084958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:47.085651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:47.086109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:47.086533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:47.227865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:47.236394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0f00d8a3-af8a-425b-9ef4-a615aea2b606 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163440 Aug 29 23:01:47.236965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1043/2195] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:47.379029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:47.379642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:47.386796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:47.387270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:47.387730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:47.388621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:47.389042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:47.389460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:47.455724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:47.464933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:47.466387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:47.467594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0cc040e2-46e3-46c6-93f3-4a2400218a43 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092633 Aug 29 23:01:47.468173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1153/2196] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:48.259044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:48.259729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:48.266262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:48.266747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:48.267352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:48.268054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:48.268536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:48.268963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:48.398664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:48.407079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f8aa1a15-838b-4ebb-ab54-fa1a59ccd538 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.152590 Aug 29 23:01:48.407648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1044/2197] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:48.491659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:48.492238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:48.498569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:48.499051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:48.499485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:48.500263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:48.500792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:48.501250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:48.562980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:48.572534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:48.573995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:48.575117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0c395b24-ce65-4ce5-837d-8a96b590d43c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088074 Aug 29 23:01:48.575676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1154/2198] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:49.427993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:49.428718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:49.435877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:49.436399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:49.436837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:49.437536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:49.438016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:49.438440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:49.571880 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:49.580512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-49b6b18e-9c91-409e-ace0-d7c380f9ebe1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.156386 Aug 29 23:01:49.581134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1045/2199] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:49 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:01:49.597063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:49.597667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:49.604302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:49.604780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:49.605215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:49.605894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:49.606437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:49.607053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:49.673318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:49.682066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:49.683452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:49.684628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a392afb1-d003-48c8-acd8-37c5e63332d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091496 Aug 29 23:01:49.685187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1155/2200] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:50.602755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:50.603316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:50.610487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:50.610963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:50.611394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:50.612072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:50.612549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:50.612965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:50.710149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:50.710757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:50.718219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:50.718712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:50.719168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:50.719904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:50.720388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:50.720810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:50.750824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:50.759533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3b3c4826-5573-42be-816f-f8b8e52c55e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160716 Aug 29 23:01:50.760109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1046/2201] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:50.785868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:50.795808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:50.797313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:50.798567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-daba26d2-a3ec-4d44-b0bd-e62ed8353c58 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093117 Aug 29 23:01:50.799139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1156/2202] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:01:51.781725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:51.782523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:51.789722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:51.790220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:51.790655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:51.791365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:51.791817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:51.792315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:51.826580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:51.827342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:51.834252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:51.835024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:51.835593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:51.836366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:51.836829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:51.837256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:51.911494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:51.921982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:51.923748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:51.924916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cf43151f-4989-4546-afd7-096abb6d7453 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.106933 Aug 29 23:01:51.935664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1157/2203] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:51.939554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:51.949421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-17a8fe2a-6aa4-4bee-97d0-bfbc29970c84 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171413 Aug 29 23:01:51.950074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1047/2204] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:52.947161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1f080f3b-0fd2-4de8-bc6f-0359e6c58244] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 23:01:52.950870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:52.951482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:52.957675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:52.958185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:52.958625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:52.959327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:52.960505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:52.961006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:52.971166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:52.971766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:52.979310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:52.979821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:52.991603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:52.991603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:52.991603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:52.991603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:53.027895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:53.036888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:53.038531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:53.039668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c997b0d9-820f-4c62-be7d-0150143279bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093904 Aug 29 23:01:53.040450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1158/2205] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:53.119640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:53.123263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:01:53.128448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f516da9e-9fa0-4ee7-8f2f-75e86ae6638d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161265 Aug 29 23:01:53.129035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1048/2206] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:01:54.063179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:54.063840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:54.072038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:54.072456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:54.072890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:54.073590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:54.074037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:54.074456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:54.080606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] [1f080f3b-0fd2-4de8-bc6f-0359e6c58244] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 53344. Aug 29 23:01:54.143616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:54.151631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:54.152276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:54.153109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:54.154553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:54.155691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3c7413cc-4d1f-4cc7-8ad8-288cadd2b3b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096550 Aug 29 23:01:54.156702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1159/2207] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:54.159843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:54.160482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:54.160929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:54.161698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:54.162151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:54.163049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:54.292627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:54.300897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-10492a85-fa69-452d-a4e9-4b2b18377912 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.154032 Aug 29 23:01:54.301464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1049/2208] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:01:55.179306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:55.180013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:55.186712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:55.187198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:55.187630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:55.188362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:55.188816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:55.189237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:55.251958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:55.260820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:55.262261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:55.263381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bb14e9b7-79be-4774-b6b9-4c37955969fc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088261 Aug 29 23:01:55.263933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1160/2209] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:55 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:55.323322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:55.323929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:55.331005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:55.331493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:55.331926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:55.332671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:55.333129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:55.333610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:55.474922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:55.483513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-019ec2b8-e2c7-4612-83e1-3f958f89fd02 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.164160 Aug 29 23:01:55.484093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1050/2210] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:56.286721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:56.287338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:56.294690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:56.295185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:56.295627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:56.296369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:56.296828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:56.297255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:56.360179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:56.370158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:56.371687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:56.372871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7e988d0e-2073-4f61-ae70-e10e9a0497d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090084 Aug 29 23:01:56.373440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1161/2211] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:56.505006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:56.505548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:56.512893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:56.513387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:56.513829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:56.514527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:56.514987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:56.515426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:56.649476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:56.657851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cfabdc07-3f4f-45c9-bc39-e639f61598bb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.156760 Aug 29 23:01:56.658422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1051/2212] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:57.396381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:57.399015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:57.404904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:57.405397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:57.405835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:57.406537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:57.406994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:57.407427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:57.470446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:57.479719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:57.481200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:57.482345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-489bb8b0-c98c-4280-b898-91ec7b3953d8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090028 Aug 29 23:01:57.482894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1162/2213] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:57.679233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:57.679789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:57.686378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:57.686858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:57.687296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:57.687997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:57.688482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:57.688904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:57.821268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:57.830304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bb853b54-0c61-49ba-bf74-a767c4d413cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155035 Aug 29 23:01:57.830881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1052/2214] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:01:58.506757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:58.507336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:58.514530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:58.515013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:58.515461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:58.516159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:58.516623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:58.517047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:58.582249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:58.591896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:58.593396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:58.594536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c53c0fd9-e891-4409-b1eb-544592de306d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092009 Aug 29 23:01:58.595131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1163/2215] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:01:58.852792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:58.853353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:58.859829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:58.860418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:58.860849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:58.861536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:58.862087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:58.862509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:59.009278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:59.020606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1f995a36-fcde-4f92-af92-c64e1506a930 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171242 Aug 29 23:01:59.021388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1053/2216] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:01:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:01:59.617068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:01:59.617742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:01:59.625713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:59.626202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:59.626869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:59.627613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:01:59.628127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:01:59.629051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:01:59.706287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:59.717086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:59.718662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:01:59.719855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d6a041bf-73e5-4c4c-be92-89c41f427ddf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.106919 Aug 29 23:01:59.720473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1164/2217] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:01:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:00.046448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:00.047619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:00.058763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:00.059626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:00.060073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:00.060820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:00.061276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:00.061704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:00.218591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:00.227472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b857b389-00c4-445c-baf7-207140fa0b9b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.185848 Aug 29 23:02:00.227943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1054/2218] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:00.744882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:00.746248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:00.753035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:00.753514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:00.753947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:00.754657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:00.755096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:00.755519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:00.817421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:00.826635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:00.828124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:00.829331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-20a04d63-94f8-4661-8d5d-26184899f2ad tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088601 Aug 29 23:02:00.829963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1165/2219] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:01.251907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:01.252560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:01.259032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:01.259510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:01.259935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:01.261422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:01.261876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:01.262312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:01.399371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:01.407882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b27418cf-b55b-4fbf-be52-83a0c9349f43 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159891 Aug 29 23:02:01.408483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1055/2220] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:01.852943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:01.853571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:01.860354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:01.860890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:01.861330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:01.862027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:01.862486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:01.862914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:01.927744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:01.937257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:01.938781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:01.939930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f0695dfa-d34f-47d3-9709-d00465ab2226 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091132 Aug 29 23:02:01.940530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1166/2221] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:02.430148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:02.430764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:02.437506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:02.437978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:02.438409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:02.439138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:02.439584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:02.440009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:02.577795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:02.586086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fd900f88-5c01-4bb3-b6fe-d4d95b3f5cd5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159815 Aug 29 23:02:02.586669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1056/2222] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:02.963143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:02.964062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:02.970595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:02.971077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:02.971503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:02.972218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:02.972674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:02.973094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:03.041583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:03.051239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:03.052707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:03.053845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c4d74195-7630-4ca7-b618-e46cb86206b2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094705 Aug 29 23:02:03.054405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1167/2223] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:03.607671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:03.608383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:03.614911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:03.615392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:03.615826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:03.616555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:03.617003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:03.617427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:03.752291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:03.761594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f27d805b-8901-484b-8310-b4ed00858724 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.157722 Aug 29 23:02:03.762176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1057/2224] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:04.078244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:04.078852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:04.085956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:04.086477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:04.086924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:04.087576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:04.088028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:04.088505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:04.153452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:04.162600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:04.164040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:04.165214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ab7e9efd-dded-4609-aa31-fde29d4a2410 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090841 Aug 29 23:02:04.165779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1168/2225] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:04.783656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:04.784492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:04.791473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:04.792768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:04.793124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:04.793848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:04.794302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:04.794728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:04.938789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:04.947455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a4994c96-68e3-4ee5-bbfb-acd714620043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167776 Aug 29 23:02:04.948031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1058/2226] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:05.189004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:05.189674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:05.195593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:05.196082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:05.196559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:05.197251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:05.197702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:05.198621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:05.218438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:05.262984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:05.272329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:05.273783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:05.274934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-11af1396-3a2a-4c0d-bc86-4c455871928a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090983 Aug 29 23:02:05.275503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1169/2227] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:05.970061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:06.089444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:06.089444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:06.089444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:06.089444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:06.090552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:06.090552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:06.090552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:06.124933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:06.133307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d69435a5-5b91-4f90-8fbb-c8b28b79de42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167364 Aug 29 23:02:06.133883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1059/2228] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:06.298540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:06.299134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:06.305606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:06.306084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:06.306523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:06.307751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:06.308240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:06.308673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:06.371432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:06.380603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:06.382027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:06.383170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-980898c7-7c9d-42d0-bbab-a667327b343f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088562 Aug 29 23:02:06.383733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1170/2229] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:07.155161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:07.155773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:07.162459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:07.162954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:07.163397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:07.164096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:07.164658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:07.165110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:07.304217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:07.313379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d87f1124-666b-49f8-858e-8522c2f2e632 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162101 Aug 29 23:02:07.314302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1060/2230] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:07.406937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:07.407547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:07.414137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:07.414617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:07.415085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:07.415774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:07.416257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:07.417222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:07.484705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:07.493335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:07.495677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:07.496730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a0fdf023-40ed-40cb-a9c9-10525b7ee799 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093839 Aug 29 23:02:07.497297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1171/2231] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:08.335803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:08.336444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:08.343569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:08.344054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:08.344518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:08.345209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:08.345687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:08.346116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:08.478774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:08.487670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d7f52be5-f097-47b0-8c8b-ef2b7cd3b6fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155809 Aug 29 23:02:08.488265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1061/2232] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:08.520053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:08.520704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:08.527217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:08.527821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:08.528456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:08.529158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:08.529685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:08.530116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:08.597126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:08.605761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:08.607192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:08.608359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-230bce8a-00a5-43f7-ba9f-88b8ead6d9cc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092165 Aug 29 23:02:08.608928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1172/2233] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:09.510504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:09.511109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:09.519172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:09.520177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:09.520629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:09.521333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:09.521787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:09.522209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:09.630811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:09.631499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:09.639050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:09.639631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:09.640158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:09.640872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:09.641322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:09.641735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:09.704412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:09.713354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:09.715426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:09.716675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4b015a70-7baa-4e0f-bf9c-e63aca49616f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089700 Aug 29 23:02:09.724380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1173/2234] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:09.743411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:09.752068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-64ec623d-5075-4648-8052-0ffa91263565 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.245615 Aug 29 23:02:09.752688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1062/2235] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:10.739208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:10.739837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:10.746487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:10.747004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:10.747458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:10.748199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:10.748658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:10.749105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:10.774404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:10.775003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:10.782363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:10.782863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:10.783290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:10.783992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:10.784479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:10.784904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:10.812632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:10.821656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:10.823086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:10.824472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6b6316df-44da-45e3-b379-a3ab1310cbf4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089170 Aug 29 23:02:10.825033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1174/2236] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:10.916886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:10.926027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3ad5d87b-b2e5-417d-81ba-8a269801bdef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155530 Aug 29 23:02:10.926602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1063/2237] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:02:11.847097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:11.847739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:11.854369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:11.854858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:11.855790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:11.856792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:11.857284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:11.857715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:11.924346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:11.933071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:11.935163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:11.936331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-02f7bba6-6370-4106-b386-037fbc249b1b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093220 Aug 29 23:02:11.936893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1175/2238] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:11.948033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:11.948678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:11.955141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:11.955654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:11.956089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:11.956834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:11.957292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:11.957719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:12.094299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:12.102932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c74b4d81-90d0-4969-8d65-16c2c1427fbc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158503 Aug 29 23:02:12.103430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1064/2239] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:12.959475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:12.960099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:12.967195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:12.967687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:12.968128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:12.968858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:12.969455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:12.969806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:13.034885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:13.044530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:13.045999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:13.047160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fb954fd8-e2af-47aa-88cf-ce05ef67f670 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091718 Aug 29 23:02:13.047731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1176/2240] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:13.125597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:13.126269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:13.132696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:13.133173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:13.133604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:13.134280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:13.134727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:13.135146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:13.153239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:13.265329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:13.273506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef1e238b-aa94-4ae0-be2f-ff19deeceb74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.152483 Aug 29 23:02:13.274114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1065/2241] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:14.071566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:14.072237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:14.079361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:14.079845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:14.080329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:14.081030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:14.081493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:14.081925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:14.145738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:14.155805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:14.157444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:14.158602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8dd0fa45-7fc9-4dde-848a-8c0006d0dc1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091030 Aug 29 23:02:14.159169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1177/2242] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:14.294468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:14.295079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:14.301887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:14.302371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:14.302803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:14.303489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:14.303940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:14.304400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:14.432823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:14.441922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9be82cc7-3579-4c4c-b9ed-653dbd3da871 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.151172 Aug 29 23:02:14.442493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1066/2243] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:15.182351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:15.182916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:15.189437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:15.189917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:15.190360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:15.191044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:15.191757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:15.192214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:15.253068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:15.261782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:15.263383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:15.264569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9919f9c0-42a9-40e1-ac3a-35b50eec0745 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.086187 Aug 29 23:02:15.265139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1178/2244] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:15.463317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:15.463853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:15.466490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=52 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:15.471169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:15.471645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:15.472091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:15.475037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:15.475037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:15.475037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:15.606116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:15.614364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9df64407-5f91-4221-b850-61cdbcccd93a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155151 Aug 29 23:02:15.614938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1067/2245] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:16.289776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:16.290393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:16.292732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=56 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:16.297337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:16.297846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:16.298274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:16.298955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:16.299399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:16.299851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:16.368321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:16.377441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:16.378880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:16.380034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-df836e90-b18d-4ef4-9760-d4c0dcbe9bb4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094180 Aug 29 23:02:16.380633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1179/2246] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:16.638056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:16.638698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:16.645104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:16.645587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:16.646021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:16.646706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:16.647158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:16.647630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:16.781520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:16.789735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e1a11a60-1fa9-4551-abde-a44283974692 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.156302 Aug 29 23:02:16.790300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1068/2247] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:17.403678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:17.404321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:17.410960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:17.411443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:17.411881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:17.412620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:17.413075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:17.413501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:17.478554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:17.488911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:17.490655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:17.491809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2c0dd6de-bd2f-44b9-a981-5ba303d98a7d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093017 Aug 29 23:02:17.492549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1180/2248] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:17.811500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:17.812065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:17.819199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:17.819689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:17.820115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:17.820830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:17.821274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:17.821695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:18.103382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:18.111973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-86f2e295-214f-4c91-8ba1-1cd247c3c398 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.304758 Aug 29 23:02:18.112587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1069/2249] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:18.515714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:18.516395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:18.522896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:18.523379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:18.523819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:18.524542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:18.525000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:18.525425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:18.590804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:18.599834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:18.601361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:18.602513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cc34ab95-9865-4325-bf85-23e9b2451ad5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090820 Aug 29 23:02:18.603103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1181/2250] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:19.133977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:19.134593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:19.142027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:19.142508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:19.142942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:19.143630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:19.144078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:19.144528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:19.298459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:19.307305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ebf425a9-d87b-41d4-ac56-04df0c4d3e95 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.177222 Aug 29 23:02:19.307912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1070/2251] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:19.625382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:19.625986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:19.632513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:19.632986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:19.633413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:19.634104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:19.634552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:19.635007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:19.703082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:19.712178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:19.713629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:19.715270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7689dc4f-a6b6-4ee4-b776-7273cbfe447c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094427 Aug 29 23:02:19.715840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1182/2252] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:20.330378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:20.330982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:20.337537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:20.338010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:20.338438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:20.339207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:20.340387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:20.340840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:20.474644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:20.483032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-80f67ef7-4f94-4876-bce0-9bb1f0c1cd1f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.156519 Aug 29 23:02:20.483597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1071/2253] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:20.739214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:20.739861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:20.747148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:20.747632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:20.748076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:20.748878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:20.749333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:20.749759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:20.814396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:20.823173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:20.825017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:20.826144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-86094641-e5ec-4a3f-99f3-1e47a518cac5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090997 Aug 29 23:02:20.826700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1183/2254] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:21.504804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:21.505398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:21.512669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:21.513156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:21.513587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:21.514287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:21.514732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:21.515158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:21.650662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:21.660112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6aaa24b7-239b-4fe2-9901-bd6342ff12f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159141 Aug 29 23:02:21.660800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1072/2255] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:21.847913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:21.848616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:21.854944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:21.855396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:21.855830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:21.856554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:21.857003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:21.857420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:21.919032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:21.927931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:21.929426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:21.930556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-80846987-9a2a-4876-949e-d1fb6b75a87e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.086592 Aug 29 23:02:21.931109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1184/2256] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:22.682583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:22.683378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:22.689450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:22.689924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:22.690355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:22.691023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:22.691719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:22.692155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:22.823776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:22.832010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-817496da-1ffa-49af-9c82-dc06e34c1132 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.153352 Aug 29 23:02:22.832615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1073/2257] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:22.954658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:22.955539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:22.962374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:22.962857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:22.963290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:22.964541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:22.965392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:22.965545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:23.032954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:23.042300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:23.043968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:23.045167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-01e8b001-c7ee-4bbc-8205-c14cb9d05ffe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095574 Aug 29 23:02:23.045751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1185/2258] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:23.853823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:23.855090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:23.861666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:23.862158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:23.862594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:23.863282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:23.863764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:23.864218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:24.002164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:24.010776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1f79bfe9-7e6a-47c9-9c08-ae97e59def8b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160814 Aug 29 23:02:24.011378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1074/2259] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:24.069271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:24.069858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:24.076610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:24.077083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:24.077505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:24.078196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:24.078642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:24.079060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:24.083491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:24.143769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:24.154020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:24.156300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:24.158011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2e17a8d9-1396-4ad5-b387-a10f7b1313d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092819 Aug 29 23:02:24.158588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1186/2260] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:25.031112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:25.031628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:25.038111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:25.038590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:25.039027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:25.039707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:25.040184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:25.040612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:25.169100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:25.177940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-53156f7e-63c5-4d3d-92cc-75e88b20f04d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.150799 Aug 29 23:02:25.178500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1075/2261] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:02:25.182175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:25.183347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:25.189814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:25.190295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:25.190733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:25.191688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:25.192158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:25.192592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:25.257152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:25.265766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:25.267213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:25.268380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f01ba097-c383-46c8-860e-bcfb04c51c61 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090480 Aug 29 23:02:25.268935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1187/2262] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:26.201145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:26.201697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:26.207947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:26.208456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:26.208877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:26.209545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:26.209992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:26.210407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:26.291034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:26.291648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:26.298595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:26.299082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:26.299522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:26.300255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:26.300716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:26.301143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:26.338165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:26.347465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-84a1cb06-1e0a-4eab-ac6d-0ae9c148e077 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.150807 Aug 29 23:02:26.348058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1076/2263] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:26.365098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:26.374669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:26.376120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:26.377309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-71d7226b-8b98-4f21-91ae-3aac73abff8e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090253 Aug 29 23:02:26.377866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1188/2264] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:27.369048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:27.369668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:27.376432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:27.380332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:27.380332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:27.380332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:27.380332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:27.380935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:27.400807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:27.402069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:27.409667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:27.410272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:27.410826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:27.411636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:27.412343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:27.412927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:27.486371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:27.496815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:27.498328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:27.499527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b9424f7e-1d5c-4cbc-8a85-32985b27a9bf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102686 Aug 29 23:02:27.500169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1189/2265] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:27.536796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:27.545992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fc2ba582-82a4-4934-b5e6-cb694fca1c4d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.180611 Aug 29 23:02:27.546377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1077/2266] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:28.523076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:28.523671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:28.530393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:28.530884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:28.531327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:28.532026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:28.532511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:28.532944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:28.567117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:28.568196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:28.580240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:28.581120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:28.581922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:28.583156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:28.583989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:28.584804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:28.612794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:28.629730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:28.632620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:28.634830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9d5e2057-d845-4277-b88f-d03fc7bfe6a1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.115584 Aug 29 23:02:28.635896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1190/2267] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:28.729806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:28.739198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f9cec67f-23e1-40db-a354-e6081e4f6aca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.176090 Aug 29 23:02:28.739787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1078/2268] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:29.673719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:29.674319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:29.680717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:29.681200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:29.681630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:29.682312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:29.682849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:29.683273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:29.752671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:29.762155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:29.762857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:29.763001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:29.764575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:29.765734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-040cdd4e-1d87-4121-a061-c2ec2d3ee8a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095985 Aug 29 23:02:29.766291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1191/2269] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:29.769652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:29.770147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:29.770576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:29.771277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:29.771733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:29.772173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:29.906744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:29.914888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4c5d9ba8-2ce1-4819-8706-f28d9e921465 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.157264 Aug 29 23:02:29.915680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1079/2270] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:02:30.789605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:30.790241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:30.797384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:30.797862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:30.798299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:30.798979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:30.799433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:30.799854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:30.861038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:30.869654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:30.871970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:30.873135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-23006fc0-c8b7-4e3c-9b49-c2cd639e3b3e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.087418 Aug 29 23:02:30.873701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1192/2271] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:30.936551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:30.937161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:30.943799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:30.944343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:30.944778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:30.945462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:30.945908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:30.946451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:31.074832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:31.083474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4cc798ba-10b2-4410-9ae9-77a0d8dd5067 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.151172 Aug 29 23:02:31.084045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1080/2272] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:31.895697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:31.896336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:31.902811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:31.903298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:31.903776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:31.904449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:31.904908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:31.905334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:31.968565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:31.977907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:31.980075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:31.981247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6466723d-b285-4c29-a917-cac69d0fb862 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089532 Aug 29 23:02:31.981810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1193/2273] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:32.105664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:32.106188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:32.112640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:32.113121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:32.113755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:32.114441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:32.114892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:32.115317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:32.244225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:32.252990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-94234a0e-ac80-4f0c-a5fa-22b86b077c1a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.151901 Aug 29 23:02:32.253560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1081/2274] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:33.004543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:33.005306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:33.013588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:33.014107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:33.014506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:33.015237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:33.015647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:33.016109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:33.079228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:33.088205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:33.090521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:33.091702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7a64a2ea-7a6c-48e5-8c6f-36c7e91d4269 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091096 Aug 29 23:02:33.092333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1194/2275] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:33.274273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:33.274818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:33.281327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:33.281809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:33.282248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:33.282931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:33.283384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:33.283814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:33.287779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:33.413521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:33.422005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7ab42234-e087-4bff-aad8-5daaaf09f7fc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.151663 Aug 29 23:02:33.422581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1082/2276] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:34.114780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:34.115407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:34.122404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:34.122879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:34.123309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:34.124011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:34.124485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:34.124905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:34.188523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:34.197364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:34.198865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:34.199981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-11e8e9c6-98a3-471d-ba40-df6f6ef676f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089072 Aug 29 23:02:34.200574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1195/2277] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:34.443423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:34.443956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:34.451789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:34.452298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:34.452919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:34.453622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:34.454075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:34.454496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:34.583331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:34.592379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-08c7e36a-5ec9-4d82-aa5b-c033a6abb7a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.153100 Aug 29 23:02:34.592994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1083/2278] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:35.223213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:35.223769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:35.231253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:35.231740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:35.232203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:35.232902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:35.233355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:35.233778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:35.295832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:35.304620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:35.306164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:35.308022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3dbf5f95-e85a-4c20-bf21-de6bf2e33237 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088071 Aug 29 23:02:35.308695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1196/2279] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:35.614580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:35.615137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:35.622124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:35.622611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:35.623049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:35.623738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:35.624209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:35.624631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:35.769647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:35.778517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-598ab88b-bab4-4e34-8896-40437d74befd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168032 Aug 29 23:02:35.779085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1084/2280] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:36.331251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:36.331850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:36.338692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:36.339468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:36.339629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:36.340355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:36.340806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:36.341227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:36.406177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:36.415557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:36.417147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:36.418391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ccb9a77d-ce6a-418d-9bdf-4c0c2d43c142 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091127 Aug 29 23:02:36.418989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1197/2281] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:36.803298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:36.803911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:36.810876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:36.811473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:36.811918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:36.812734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:36.813190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:36.813616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:36.959429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:36.968419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e81fc78a-9010-4578-a843-f3efa17076b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169031 Aug 29 23:02:36.969014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1085/2282] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:37.450780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:37.451384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:37.458129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:37.462087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:37.462087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:37.462087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:37.462087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:37.462491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:37.528019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:37.536744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:37.538200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:37.539337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6f16ca16-56eb-46ba-b619-99889063c321 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093149 Aug 29 23:02:37.539937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1198/2283] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:37.989903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:37.990590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:37.997082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:37.997562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:37.997999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:37.998680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:37.999128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:37.999550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:38.135258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:38.144160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-605178ab-33e6-4bf5-8671-827a46cad2a6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158089 Aug 29 23:02:38.144765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1086/2284] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:38.563277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:38.563837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:38.570886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:38.571368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:38.571806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:38.572535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:38.572984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:38.573437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:38.640973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:38.649924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:38.651378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:38.653229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-50ab1a9f-9e6b-4d82-a275-2cac077bfd20 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094116 Aug 29 23:02:38.653828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1199/2285] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:39.166005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:39.166607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:39.173423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:39.173835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:39.174274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:39.174958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:39.175410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:39.175835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:39.550310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:39.558938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-70973e58-cab2-4722-98f1-26fdd470bfd4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.396587 Aug 29 23:02:39.559527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1087/2286] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:39.679085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:39.679766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:39.687993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:39.688522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:39.688953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:39.689648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:39.690098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:39.690516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:39.755402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:39.765431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:39.766936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:39.768124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-77d499ac-cdf2-4813-b7c2-8a842e021648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094631 Aug 29 23:02:39.768711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1200/2287] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:40.580689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:40.581325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:40.588074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:40.588598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:40.589923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:40.591180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:40.591608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:40.592027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:40.739622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:40.749443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-15e8637a-e4af-4873-a54e-c8c6d97965fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.172618 Aug 29 23:02:40.750428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1088/2288] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:40.792026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:40.792943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:40.799926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:40.800456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:40.800929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:40.801658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:40.802160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:40.802661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:40.872320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:40.881642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:40.883094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:40.884299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e4dbcf37-58f8-4404-8378-aaee90bf1cb6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096407 Aug 29 23:02:40.884870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1201/2289] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:41.774890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:41.775636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:41.783025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:41.783499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:41.783924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:41.784639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:41.785086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:41.785504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:41.908464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:41.909097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:41.915884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:41.916407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:41.916843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:41.917685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:41.918145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:41.918571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:41.952448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:41.961916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c5c5343b-af88-426e-9de8-d3f06bf4ecd2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.192615 Aug 29 23:02:41.962520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1089/2290] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:41.986143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:41.990749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:41.997712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:42.004566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:42.004566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ea612850-8073-4ef7-a4d3-fd08439bd3e8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095904 Aug 29 23:02:42.004566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1202/2291] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:42.984701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:42.985436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:42.992268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:42.992761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:42.993203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:42.993896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:42.994352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:42.994776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:43.027187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:43.027980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:43.034894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:43.035378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:43.035809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:43.036542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:43.036996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:43.037415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:43.122349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:43.131493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:43.133005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:43.134164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6022f3b8-a24d-46f6-abf3-fd9c4506e404 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.111656 Aug 29 23:02:43.134730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1203/2292] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:43.145643 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:43.155328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e5d3f22f-b168-4c4a-bb0b-15e9cc89db82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.175293 Aug 29 23:02:43.156180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1090/2293] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:44.158418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:44.159130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:44.166021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:44.166508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:44.166947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:44.168214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:44.168769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:44.169250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:44.179956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:44.180753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:44.189634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:44.190129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:44.190832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:44.191573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:44.192034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:44.192493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:44.246054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:44.256744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:44.258249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:44.259465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ef1de65c-7afb-4789-8ce0-d99ee710e4de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.105155 Aug 29 23:02:44.261748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1204/2294] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:44.341784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:44.350511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-81b7add4-2a0f-474f-a963-e72f9c2c2785 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.175228 Aug 29 23:02:44.351107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1091/2295] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:02:45.282500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:45.283063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:45.289759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:45.290236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:45.290667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:45.291358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:45.291803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:45.292456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:45.359272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:45.368629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:45.370080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:45.371246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9b48ea48-c447-4049-8b34-ffafb9606648 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092740 Aug 29 23:02:45.371793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1205/2296] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:45.376717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:45.377742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:45.389608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:45.390312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:45.390854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:45.391861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:45.392435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:45.392866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:45.538179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:45.546786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0c0fbca0-8e06-46b3-9ae1-e2b8f06bc2fd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.177177 Aug 29 23:02:45.547370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1092/2297] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:46.394874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:46.395514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:46.397961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=54 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:46.403074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:46.408664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:46.408664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:46.408664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:46.408664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:46.409378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:46.473367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:46.483243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:46.484726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:46.485869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9e9ac774-f8e5-47ae-931d-8416fdab7498 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095031 Aug 29 23:02:46.486424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1206/2298] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:46.569566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:46.570118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:46.572480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=52 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:46.577330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:46.578475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:46.578475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:46.578942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:46.579459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:46.579772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:46.720454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:46.729101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e5029b7e-d799-447e-bf45-86ec87a4896f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163855 Aug 29 23:02:46.730385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1093/2299] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:46 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:47.509649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:47.510255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:47.517359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:47.517844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:47.518279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:47.518968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:47.519508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:47.519937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:47.586560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:47.596824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:47.602595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:47.602595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6f79c896-201f-489e-bb74-e499a15518d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093767 Aug 29 23:02:47.602595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1207/2300] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:47.751400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:47.752216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:47.758923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:47.759401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:47.759831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:47.760537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:47.761726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:47.762242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:47.896875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:47.906948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6efe7719-0c6e-4843-ac7f-8d5dd74cce3f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159379 Aug 29 23:02:47.907534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1094/2301] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:48.624035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:48.624684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:48.631145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:48.631629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:48.632070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:48.632790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:48.633248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:48.633678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:48.695732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:48.704830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:48.706269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:48.707408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1d83fb0a-42f4-49d2-b038-c81e120f425c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088151 Aug 29 23:02:48.707973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1208/2302] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:48.928566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:48.929174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:48.935772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:48.936286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:48.936719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:48.937400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:48.937847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:48.938266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:49.067032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:49.075397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0b831cdf-10a4-4692-ba93-18ee3d93050f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.150689 Aug 29 23:02:49.076012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1095/2303] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:49.730491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:49.731097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:49.737752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:49.738246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:49.738684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:49.739414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:49.739875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:49.740335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:49.804275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:49.813621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:49.815189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:49.816627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e977ce3b-4903-4459-a63f-5e442ac8368a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090201 Aug 29 23:02:49.817264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1209/2304] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:50.097366 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:50.097919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:50.104966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:50.105547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:50.105987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:50.106677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:50.107126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:50.107552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:50.238895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:50.247832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1c4d7053-2ed0-4e6b-add3-830e7a735c66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.154386 Aug 29 23:02:50.248431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1096/2305] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:50.841504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:50.842218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:50.849055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:50.849546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:50.849992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:50.850703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:50.851159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:50.851586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:50.920207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:50.934604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:50.937570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:50.939733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-860d921b-6d5d-4aa1-a270-0119c24f505d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102731 Aug 29 23:02:50.941062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1210/2306] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:51.270064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:51.270843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:51.277726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:51.278200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:51.278635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:51.279314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:51.279755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:51.280198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:51.413372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:51.421998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b111022e-aa3a-481a-9e7b-b15e8081b01c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155793 Aug 29 23:02:51.422605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1097/2307] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:51.962986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:51.963598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:51.971037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:51.971530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:51.971961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:51.972701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:51.973161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:51.973587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:52.044520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:52.053679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:52.055133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:52.056316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-888efd46-d0dc-4775-ad2d-061486263dbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097280 Aug 29 23:02:52.056884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1211/2308] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:52.444959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:52.445557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:52.452786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:52.453272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:52.453737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:52.454429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:52.454882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:52.455302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:52.594727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:52.598280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:52.603400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-09408ce7-6ef5-45c5-a86c-11ebb3340d6b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162798 Aug 29 23:02:52.604004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1098/2309] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:53.078662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:53.079267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:53.086190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:53.086686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:53.087137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:53.087999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:53.088488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:53.089048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:53.155893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:53.164829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:53.166297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:53.168169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0e4f31b4-62f7-4d4f-82f6-032632fed362 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093479 Aug 29 23:02:53.168734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1212/2310] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:53.640065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:53.640741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:53.648097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:53.648613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:53.649073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:53.649766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:53.650208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:53.650624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:53.798668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:53.808450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-77f7516a-f239-46b8-ac62-03f18ca9ac12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.172489 Aug 29 23:02:53.809050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1099/2311] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:02:54.192131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:54.192713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:54.199625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:54.200117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:54.200589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:54.201325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:54.201782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:54.202239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:54.206957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:02:54.207162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 (ip 10.222.0.59) !!! Aug 29 23:02:54.271984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:54.283856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:54.285572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:54.286852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-96ac8b15-f53f-40bb-9942-0cee9b237685 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.099315 Aug 29 23:02:54.287749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1213/2312] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:54.831506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:54.832111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:54.834258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:02:54.834413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 (ip 10.222.0.59) !!! Aug 29 23:02:54.835527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:02:54.835651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 (ip 10.222.0.59) !!! Aug 29 23:02:54.846280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:54.847254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:54.847860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:54.848630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:54.849091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:54.849530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:55.000669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:55.009227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7ee53904-4735-4dca-abc4-e21ca50682f7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.181748 Aug 29 23:02:55.009856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1100/2313] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:55.312184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:55.312837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:55.320159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:55.320664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:55.321106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:55.321813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:55.322267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:55.322693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:55.396522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:55.407291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:55.409093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:55.410403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ade478f5-224c-483e-ae09-eee1a07e6bb3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.103140 Aug 29 23:02:55.411005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1214/2314] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:55 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:02:56.031734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:56.032378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:56.039131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:56.039620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:56.040061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:56.040786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:56.041249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:56.041703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:56.177540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:56.186304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a738fc8b-551e-4f3b-826c-bdeadac57bd0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158459 Aug 29 23:02:56.186891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1101/2315] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:56.434984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:56.435553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:56.442466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:56.442945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:56.443371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:56.444066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:56.444536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:56.444958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:56.513649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:56.522769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:56.524254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:56.525406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c334cf1d-e7a6-4c03-be35-150b49258aa5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094984 Aug 29 23:02:56.525994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1215/2316] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:57.208801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:57.209399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:57.215900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:57.217176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:57.217176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:57.217534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:57.217990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:57.218415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:57.356244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:57.364978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-72c47049-ce1d-4feb-9421-5c7d6906c14f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160087 Aug 29 23:02:57.366122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1102/2317] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:57.549155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:57.549704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:57.556329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:57.556838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:57.557891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:57.558629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:57.559062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:57.559489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:57.623759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:57.633139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:57.634582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:57.636003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-221b7135-227e-4372-9ad4-ed56ce50cbbb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090784 Aug 29 23:02:57.636597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1216/2318] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:58.387437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:58.388065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:58.394786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:58.395262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:58.395696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:58.396424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:58.396869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:58.397289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:58.550662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:58.560494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9aad8430-4512-4ca2-9aca-d8fcc41fb7c1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.176920 Aug 29 23:02:58.561089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1103/2319] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:58.658621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:58.659234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:58.669422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:58.669422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:58.669422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:58.669885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:58.670731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:58.670731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:58.740662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:58.752577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:58.754388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:58.755740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bcd0a5f2-bec7-4f2c-a516-b34f27b27372 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.101166 Aug 29 23:02:58.756348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1217/2320] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:02:59.582532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:59.583132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:59.591321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:59.591806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:59.592272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:59.592966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:59.593418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:59.593841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:59.734588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:59.743054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dc55a913-f0f3-4b7d-921c-54eba772de72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.164514 Aug 29 23:02:59.743639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1104/2321] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:59.781247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:59.781850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:59.788398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:59.788883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:59.789319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:59.790014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:59.790465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:59.790890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:59.855547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:59.864724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:59.866190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:59.867332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-939dda6a-2426-452e-ada2-0c91a0aca241 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090077 Aug 29 23:02:59.867894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1218/2322] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:02:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:00.764967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:00.765588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:00.772377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:00.772860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:00.773312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:00.773992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:00.774443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:00.774864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:00.892476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:00.893103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:00.899946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:00.900475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:00.901022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:00.901643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:00.902099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:00.902534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:00.923421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:00.940846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:00.948578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e4bfdd14-09e6-4071-b530-9390eeb0d951 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.186823 Aug 29 23:03:00.949168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1105/2323] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:00.973487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:00.982603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:00.984036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:00.985211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7de0b717-f07c-4843-81c4-98e98b39922b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096814 Aug 29 23:03:00.985764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1219/2324] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:03:01.970556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:01.971155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:01.977821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:01.978310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:01.978750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:01.979442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:01.979893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:01.980373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:02.009077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:02.009770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:02.017236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:02.017837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:02.018270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:02.018997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:02.019443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:02.019863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:02.092246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:02.110373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:02.113659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:02.115977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4d97a166-b9ad-4ad5-bdda-7559d598c631 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.110497 Aug 29 23:03:02.117088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1220/2325] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:03:02.153497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:02.162571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ec849963-d055-4ce4-91f4-e6b37dccb4d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.195841 Aug 29 23:03:02.163222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1106/2326] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:03.138962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:03.139651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:03.146580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:03.147055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:03.147491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:03.148283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:03.148732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:03.149151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:03.184407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:03.184971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:03.192035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:03.192565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:03.192996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:03.193694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:03.194136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:03.194557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:03.218232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:03.235361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:03.238377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:03.240690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4d1489e8-9169-414f-98a3-3f0d1363b69d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.105438 Aug 29 23:03:03.241740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1221/2327] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:03.332755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:03.341770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-db1f5791-2141-4726-a745-56542cd177cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161334 Aug 29 23:03:03.342360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1107/2328] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:04.268245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:04.268835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:04.275409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:04.275891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:04.276353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:04.277105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:04.277623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:04.278163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:04.341155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:04.350177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:04.351639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:04.352815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-48ec251e-2b9c-479c-a6d9-195328c4ae10 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088592 Aug 29 23:03:04.353379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1222/2329] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:04.362736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:04.363346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:04.370211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:04.371293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:04.371733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:04.372557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:04.373083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:04.373471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:04.518900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:04.527344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-826a1efa-0453-476d-850c-8b265529d676 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168399 Aug 29 23:03:04.527926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1108/2330] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:05.377401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:05.377953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:05.384233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:05.384727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:05.385157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:05.385856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:05.386428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:05.386856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:05.455063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:05.464671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:05.466172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:05.467313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a66def8a-5e37-4d12-9dd3-4332ee5ef002 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094423 Aug 29 23:03:05.467873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1223/2331] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:05.550086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:05.550708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:05.557455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:05.557934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:05.558364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:05.559180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:05.559634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:05.560058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:05.693272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:05.702255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f67f76da-5e0a-49d3-9ac8-7be145401a72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.156178 Aug 29 23:03:05.702826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1109/2332] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:06.491605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:06.492254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:06.500076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:06.500600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:06.501036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:06.501744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:06.502195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:06.502610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:06.572519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:06.582081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:06.583631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:06.584884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9abe2276-0119-4d0e-8bdf-340d3d24a07d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097309 Aug 29 23:03:06.585511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1224/2333] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:06.724569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:06.725169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:06.731856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:06.732378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:06.732816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:06.733501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:06.733944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:06.734356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:06.874158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:06.882731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8ae6b911-8698-4ead-9d47-289a93184170 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162121 Aug 29 23:03:06.883317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1110/2334] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:07.607698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:07.608361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:07.614843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:07.615315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:07.615749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:07.616531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:07.616979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:07.617397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:07.682007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:07.691148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:07.692643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:07.693836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e0fc4195-8422-402c-9203-6916fac41758 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090797 Aug 29 23:03:07.694403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1225/2335] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:07.909485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:07.910576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:07.923452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:07.924356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:07.925078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:07.926309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:07.927517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:07.928007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:08.074889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:08.083700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d5269549-0dfb-4adb-9ef3-a9244b622acd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.182003 Aug 29 23:03:08.084320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1111/2336] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:08.717855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:08.718454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:08.724939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:08.725416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:08.725845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:08.726525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:08.726971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:08.727396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:08.791113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:08.801450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:08.802892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:08.804055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e8e91ac2-9065-4108-b398-efbe0a14cd5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090189 Aug 29 23:03:08.810123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1226/2337] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:09.106958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:09.107936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:09.114591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:09.115079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:09.115519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:09.116250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:09.116711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:09.117134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:09.251918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:09.260083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b5528554-0933-480a-8d65-002a9981501d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158250 Aug 29 23:03:09.260668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1112/2338] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:09.827467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:09.828056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:09.834493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:09.834978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:09.835417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:09.836103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:09.836650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:09.837076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:09.902446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:09.911232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:09.912760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:09.913890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e7d7165e-89db-4739-a4f4-dde0e305b7bc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090461 Aug 29 23:03:09.914455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1227/2339] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:10.282498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:10.283094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:10.289662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:10.290140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:10.290572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:10.291255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:10.291706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:10.292129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:10.434428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:10.442959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e93b3cdd-20f7-43dc-ad8e-3a1a91cf84ec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165068 Aug 29 23:03:10.443531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1113/2340] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:10.938149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:10.938770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:10.945515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:10.945999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:10.946432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:10.947118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:10.947573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:10.948004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:11.010460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:11.019588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:11.021063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:11.022207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b85a1219-338b-4e92-8531-60faa70f74b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088853 Aug 29 23:03:11.022847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1228/2341] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:11.465788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:11.466380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:11.473290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:11.473776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:11.474208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:11.474906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:11.475382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:11.475782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:11.611402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:11.619657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2c01d18d-8933-44a1-8246-eb73fed2ede4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158561 Aug 29 23:03:11.627025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1114/2342] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:12.045420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:12.046110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:12.052546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:12.053030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:12.053468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:12.054156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:12.054617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:12.055043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:12.118311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:12.128349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:12.129896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:12.131034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7bb7f022-1da5-4509-9e7c-3071af15dbd1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090195 Aug 29 23:03:12.131605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1229/2343] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:12.646868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:12.647512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:12.654278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:12.654765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:12.655199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:12.655898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:12.656382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:12.656808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:12.678121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:12.802946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:12.816678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2fb3548c-4db0-4f2c-bf84-860309fe81af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.173541 Aug 29 23:03:12.817269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1115/2344] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:13.154866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:13.155515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:13.162278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:13.162764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:13.163204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:13.163900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:13.164451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:13.164881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:13.231862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:13.240844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:13.242356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:13.243519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f22001e1-45c0-4131-bf77-dac5d83727be tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093091 Aug 29 23:03:13.244094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1230/2345] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:13.839416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:13.840156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:13.847848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:13.848680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:13.849122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:13.849864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:13.850317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:13.850743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:13.998775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:14.007485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f159559a-daf0-4c11-b5c1-e30a9ffd4a13 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.172372 Aug 29 23:03:14.008105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1116/2346] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:14.266912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:14.267529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:14.274495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:14.274984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:14.275423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:14.276160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:14.276657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:14.277687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:14.350875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:14.361230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:14.362709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:14.363875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6a104ab4-4883-466d-a7c4-e7f087e946d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.100914 Aug 29 23:03:14.364607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1231/2347] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:03:15.033208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:15.033856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:15.040886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:15.041377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:15.041859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:15.042558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:15.043016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:15.043440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:15.180314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:15.190501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-21ebbc72-c08f-4968-a680-6fe06bb4e55f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161321 Aug 29 23:03:15.191086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1117/2348] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:15.388221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:15.389031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:15.396533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:15.397027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:15.397470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:15.398185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:15.398640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:15.399067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:15.468013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:15.478210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:15.480597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:15.481803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f8aad153-02b9-4017-afb3-2cf72458da59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.098459 Aug 29 23:03:15.482372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1232/2349] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:16.213940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:16.214502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:16.221296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:16.221783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:16.222214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:16.222925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:16.223376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:16.223791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:16.367804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:16.377667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-12d7dbae-b154-4697-bbcc-33883b8b9e18 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167629 Aug 29 23:03:16.378275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1118/2350] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:16.508606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:16.509446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:16.512875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=54 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:16.517993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:16.518490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:16.518927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:16.519643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:16.520101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:16.520599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:16.589009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:16.599033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:16.600540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:16.601713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6852d02a-39a1-47af-8af5-0e610d5bef97 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.099912 Aug 29 23:03:16.602289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1233/2351] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:17.066593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:17.067096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:17.069060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=52 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:17.074547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:17.075028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:17.075604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:17.076168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:17.076636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:17.077058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:17.103254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:03:17.359117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-10cf7749-6329-47a6-bba3-195cf7ba7ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 204 len: 0 microversion: 2.1 time: 0.296242 Aug 29 23:03:17.359831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1119/2352] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:03:17 2022] DELETE /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:03:17.373822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:17.374456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:17.380724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:17.381214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:17.381650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:17.382361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:17.382823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:17.383247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:17.400394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:17.401100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:17.408513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:17.409103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:17.409543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:17.410394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:17.411186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:17.411617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:17.529089 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:17.537456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a111a217-1f8d-43c8-996c-c32e0855aeb7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.167779 Aug 29 23:03:17.538082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1234/2353] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:17.558411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:17.568129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-93d5e079-0cb5-4247-aa94-c497111a4342 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.172733 Aug 29 23:03:17.568729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1120/2354] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:17.624924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:17.625546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:17.631669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:17.632218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:17.632664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:17.633356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:17.633815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:17.634240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:17.706340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:17.723562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:17.725110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:17.726732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8d57f27c-1c5f-4696-9162-789a8914fcb7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.105755 Aug 29 23:03:17.727497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1235/2355] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:18.560915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:18.561471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:18.568300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:18.568780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:18.569207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:18.569887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:18.570335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:18.570752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:18.588584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:18.589812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:18.596545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:18.597036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:18.597478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:18.598182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:18.598641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:18.599065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:18.603460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:18.717563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:18.726517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4974ff79-b0a9-47a3-b980-e51d0cd4d751 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170602 Aug 29 23:03:18.727112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1121/2356] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:18.741154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:18.749736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:18.750260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d661b391-a8c4-4fea-849f-c862905c425e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165487 Aug 29 23:03:18.750396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:18.751264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1236/2357] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:18.757037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:18.757517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:18.757943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:18.758629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:18.759081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:18.759491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:18.825597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:18.834493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:18.835936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:18.837139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a30fcc5a-5a5e-4843-9a93-574853611af2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091295 Aug 29 23:03:18.837705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1122/2358] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:03:19.748895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:19.749507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:19.756255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:19.756746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:19.757173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:19.757881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:19.758340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:19.758768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:19.774926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:19.775521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:19.783101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:19.783577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:19.784003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:19.784721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:19.785166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:19.785582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:19.900485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:19.910012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ab5b9724-3f94-40a9-a7e1-c6fb4b9e1073 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.164983 Aug 29 23:03:19.910609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1237/2359] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:19.915288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:19.916989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:19.925950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:19.932233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:19.932233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:19.932603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:19.933350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:19.933807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:19.934239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:19.935825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-56089641-1699-4a02-a5c9-6fdbc314ceb5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165917 Aug 29 23:03:19.936462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1123/2360] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:20.001477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:20.011792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:20.013370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:20.015470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e1d50d49-6cf6-4170-a34f-fe75caf93e26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102942 Aug 29 23:03:20.015470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1238/2361] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:20.934145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:20.934760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:20.941479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:20.941968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:20.942407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:20.943090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:20.943559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:20.943968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:20.957807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:20.958408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:20.965673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:20.966148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:20.966576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:20.967260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:20.967708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:20.968123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:21.080677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:21.093845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-63dd1cf4-c329-4c68-a449-4414f59929c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.164249 Aug 29 23:03:21.094626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1124/2362] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:21.110674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:21.112028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:21.112877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:21.119050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:21.119564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:21.119990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:21.120417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eb9be83a-077f-43f0-8074-b7dfea4aed9e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.166273 Aug 29 23:03:21.120803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:21.121010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1239/2363] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:21.121251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:21.121671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:21.186624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:21.195664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:21.197297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:21.198482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3e253578-c563-4f9d-bc19-daa47374ea39 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102985 Aug 29 23:03:21.199082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1125/2364] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:22.117884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:22.118509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:22.126250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:22.126739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:22.127178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:22.127887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:22.128368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:22.128793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:22.143424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:22.144026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:22.152016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:22.152538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:22.153010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:22.153683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:22.154129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:22.154553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:22.270998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:22.281514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-10da98b3-9c89-471b-b1bf-aa28441dd0c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.168219 Aug 29 23:03:22.282167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1240/2365] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:22.286674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:22.287338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:22.294747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:22.295434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:22.295925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:22.296383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:22.297245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:22.297568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:22.298074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:22.304285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d353e2ec-2458-4c04-a32b-042027979673 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.164601 Aug 29 23:03:22.304957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1126/2366] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:22.364869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:22.375163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:22.376576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:22.378014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-175ac04e-76e5-4cb4-9e7b-87430953ed83 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094947 Aug 29 23:03:22.378599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1241/2367] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:23.303290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:23.303892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:23.310340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:23.310825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:23.311271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:23.311959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:23.312440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:23.312868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:23.326929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:23.328288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:23.334793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:23.335281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:23.335716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:23.336465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:23.336888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:23.337330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:23.455253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:23.464414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1689194f-b8ee-492b-9c3a-2662b4c315ab tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.164816 Aug 29 23:03:23.465188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1127/2368] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:23.470163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:23.471097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:23.479215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:23.480501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:23.481030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:23.481859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:23.482399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:23.482901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:23.488042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:23.497547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-57d44d02-2d6a-43d2-ac69-d768cc2c4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.174522 Aug 29 23:03:23.498333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1242/2369] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:23.553436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:23.563113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:23.564847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:23.565982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fcf16361-129f-4dce-9f99-fa2450954486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.099679 Aug 29 23:03:23.566613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1128/2370] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:24.486925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:24.487558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:24.493809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:24.494290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:24.494731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:24.495561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:24.496055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:24.496511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:24.519170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:24.519805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:24.526171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:24.527409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:24.528199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:24.528928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:24.529381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:24.529802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:24.630420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:24.639264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-09e111d4-aa92-47f6-8f0f-882a5c198657 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.156142 Aug 29 23:03:24.639847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1243/2371] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:24.644360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:24.644971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:24.652161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:24.653049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:24.653606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:24.654327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:24.654759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:24.655179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:24.670737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:24.679084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fc068594-cbf8-462e-bd70-0e1133e75def tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163727 Aug 29 23:03:24.679657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1129/2372] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:24.721054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:24.729913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:24.731351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:24.732512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f1fb90c9-cd6f-49c5-976f-ec7677bcc2cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091687 Aug 29 23:03:24.733063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1244/2373] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:25.662456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:25.663052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:25.670840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:25.671327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:25.671756 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:25.672482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:25.672933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:25.673354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:25.693054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:25.700547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:25.701147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:25.707895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:25.708549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:25.708984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:25.710226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:25.710226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:25.710582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:25.818655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:25.827405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7f48b0d6-6758-4165-891d-2689c753bccb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.169465 Aug 29 23:03:25.828002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1130/2374] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:25.832659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:25.833263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:25.839881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:25.840837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:25.840978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:25.841670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:25.842118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:25.842539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:25.868642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:25.878829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-76b2f057-5f41-482e-8840-6935d8a29948 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.182168 Aug 29 23:03:25.879747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1245/2375] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:25.907223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:25.916430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:25.918455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:25.919605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9d942ba4-37eb-45c7-afa1-fd08f6ac7ff3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090661 Aug 29 23:03:25.920191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1131/2376] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:26.849853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:26.850461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:26.857784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:26.858270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:26.858705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:26.859405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:26.859853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:26.860305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:26.901377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:26.902144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:26.908959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:26.909445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:26.909888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:26.911261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:26.911261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:26.911581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:27.001905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:27.010706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-624e3547-9aba-41ca-977c-4ca9da34006b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.164921 Aug 29 23:03:27.011609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1246/2377] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:27.016864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:27.017489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:27.023871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:27.024393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:27.024841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:27.025637 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:27.025990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:27.027128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:27.054664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:27.063288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8c25a6de-0228-42fd-80f0-d0d6d4f5c5cb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165924 Aug 29 23:03:27.063882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1132/2378] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:27.092460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:27.101773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:27.103142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:27.104408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-43e0655f-acae-49ec-873a-68cc94c5dbbf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091702 Aug 29 23:03:27.105540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1247/2379] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:28.034631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:28.035312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:28.045355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:28.046128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:28.046863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:28.047935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:28.048700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:28.049486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:28.087189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:28.088109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:28.098645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:28.099418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:28.099969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:28.101036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:28.101778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:28.102423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:28.230566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:28.239817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-35e61236-45f6-4bfe-9014-ce68c095c59a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.209322 Aug 29 23:03:28.253106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1133/2380] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:28.253106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:28.253106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:28.253778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:28.253866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:28.254651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:28.254982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:28.255438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:28.255867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:28.257387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:28.271366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c07fd029-27ef-49f6-9394-abd107861141 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.189439 Aug 29 23:03:28.271975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1248/2381] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:28.322217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:28.331473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:28.332982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:28.334146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6aa74b93-a0dd-4688-9cd8-37a2a8be394c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092748 Aug 29 23:03:28.334718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1134/2382] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:29.262936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:29.263527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:29.270010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:29.270494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:29.270933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:29.271627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:29.272084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:29.272551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:29.294545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:29.295866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:29.302872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:29.303368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:29.303812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:29.305803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:29.306482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:29.307093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:29.423998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:29.432425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-02c9bf0a-c2c2-4f2d-b61c-a819e43a4437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.173535 Aug 29 23:03:29.433346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1249/2383] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:29.437664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:29.438275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:29.445291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:29.445787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:29.446225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:29.447028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:29.447482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:29.447908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:29.488347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:29.497974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8d78aa7e-65a2-4332-98f7-0e60a478f1d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.208408 Aug 29 23:03:29.498565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1135/2384] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:29.517476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:29.526853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:29.528344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:29.529515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-aa937b1a-144f-4e31-99aa-b0963789b261 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095537 Aug 29 23:03:29.530073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1250/2385] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:30.454744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:30.455331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:30.461929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:30.462408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:30.462833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:30.463523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:30.463967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:30.464413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:30.520744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:30.523666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:30.529524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:30.529966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:30.530400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:30.531126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:30.531587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:30.532011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:30.619928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:30.629668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e68f5304-e995-4ee9-a100-03d5a5c151cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.179300 Aug 29 23:03:30.630297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1136/2386] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:30.635192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:30.635804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:30.643006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:30.643488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:30.643919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:30.644644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:30.645339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:30.645763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:30.677450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:30.685868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6198d414-90ef-4c6a-b926-6a56bfcca95a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169020 Aug 29 23:03:30.686449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1251/2387] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:30.713028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:30.722762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:30.724238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:30.725375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7f04ed84-b9c2-436d-a2b3-0a2a2331fc95 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093974 Aug 29 23:03:30.725934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1137/2388] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:31.657143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:31.657760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:31.664741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:31.665230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:31.665670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:31.666451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:31.666907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:31.667365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:31.707794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:31.708438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:31.715458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:31.715949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:31.716598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:31.717313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:31.717762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:31.718192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:31.811256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:31.815150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:31.820932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-68f3c9d5-fd7c-43fc-9140-295ba85b9c1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.167611 Aug 29 23:03:31.828586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1252/2389] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:31.834085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:31.834515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:31.840752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:31.841274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:31.841710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:31.842411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:31.842856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:31.843306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:31.865054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:31.879067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8306511f-ac02-4133-be9e-5e8f9a39df75 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.175144 Aug 29 23:03:31.879669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1138/2390] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:31.930009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:31.940386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:31.941826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:31.942974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1541068a-6ebc-4582-8bb1-4242f5695fda tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.113362 Aug 29 23:03:31.943540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1253/2391] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:32.842906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:32.843504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:32.850064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:32.850568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:32.851001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:32.851697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:32.852127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:32.852571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:32.901115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:32.901834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:32.908450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:32.908938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:32.909379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:32.910072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:32.910529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:32.910956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:32.989317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:32.997716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0d7e02a6-b01f-4d30-a604-fcb8eb57aeb2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158880 Aug 29 23:03:32.998294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1139/2392] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:33.003134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:33.013609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:33.013609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:33.013609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:33.013609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:33.014110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:33.014110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:33.014110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:33.057303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:33.066426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fe806538-4f8e-4f0f-b2fc-799d75768f4e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169067 Aug 29 23:03:33.067048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1254/2393] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:33.081563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:33.090409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:33.092432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:33.093624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2ef0cf74-ae41-4f52-a760-93c0f4b33016 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094365 Aug 29 23:03:33.094160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1140/2394] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:34.020602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:34.021236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:34.027681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:34.028187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:34.028622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:34.029308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:34.029757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:34.030176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:34.089946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:34.091405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:34.097952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:34.098427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:34.098855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:34.099533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:34.099977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:34.100416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:34.163955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:34.173241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d00aca53-688f-4b46-8655-042bbbea2dcc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.156381 Aug 29 23:03:34.173735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1255/2395] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:34.178491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:34.178847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:34.185706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:34.186196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:34.186636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:34.187378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:34.187837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:34.188293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:34.241449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:34.257918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-450ed508-53c2-4ae9-900d-6d31cca85517 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.172115 Aug 29 23:03:34.259023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1141/2396] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:34.267926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:34.277338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:34.278802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:34.279945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9676fcc0-f872-4c7a-aaa9-d7be5a790a0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.105296 Aug 29 23:03:34.280541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1256/2397] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:35.196026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:35.196600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:35.203238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:35.203716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:35.204166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:35.204864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:35.205304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:35.205720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:35.283956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:35.284952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:35.290879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:35.291358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:35.291789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:35.292638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:35.293096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:35.293521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:35.338710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:35.348475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3f5eb4c8-c7b8-4c1f-95b5-25f2d504f798 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.156306 Aug 29 23:03:35.349079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1142/2398] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:35.353792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:35.354674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:35.362063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:35.362491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:35.362933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:35.363641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:35.364095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:35.364550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:35.435652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:35.437123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:35.444937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:35.445990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cf506a87-b96a-4600-90c9-b54867a0c7e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165951 Aug 29 23:03:35.446427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:35.446886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1257/2399] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:35.447562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-80ad48c4-a8e3-413c-bd3a-0a35c656f5a7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097560 Aug 29 23:03:35.448163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1143/2400] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:36.370623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:36.371228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:36.377827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:36.378301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:36.378728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:36.379400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:36.379846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:36.380297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:36.468685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:36.469321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:36.475844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:36.476371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:36.476817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:36.477514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:36.477968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:36.478387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:36.511501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:36.519842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-85f343f5-1cbb-4d16-a554-2dad6ac56c53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.152996 Aug 29 23:03:36.520461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1258/2401] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:36.526103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:36.526103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:36.531823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:36.532353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:36.532795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:36.533496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:36.533953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:36.534385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:36.602729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:36.613030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:36.614489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:36.615647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-13c295d3-a7f1-41a8-bbae-03bd17870f71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094267 Aug 29 23:03:36.616232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1259/2402] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:36.618215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:36.627286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e25f4329-d65c-4448-9186-71f8974d29bd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163382 Aug 29 23:03:36.627863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1144/2403] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:37.541956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:37.542564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:37.550100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:37.550575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:37.551004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:37.551684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:37.552131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:37.552568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:37.639993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:37.640724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:37.647301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:37.647880 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:37.648411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:37.649199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:37.649715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:37.650222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:37.681215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:37.689968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4b078472-2c03-4c2a-ad10-8a2d0e55dbf6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.151802 Aug 29 23:03:37.690785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1260/2404] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:37.695083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:37.695688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:37.701666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:37.702141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:37.702573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:37.703257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:37.703706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:37.704122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:37.713885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:37.723235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:37.724807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:37.725959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b7f717ea-53e5-4881-80d9-809e4171b91a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089840 Aug 29 23:03:37.726518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1145/2405] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:03:37.837135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:37.846204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e493d07a-bfa0-466e-8e2e-032849cc6856 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.154674 Aug 29 23:03:37.846782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1261/2406] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:38.711614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:38.712236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:38.719657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:38.720194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:38.720636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:38.721339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:38.721790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:38.722216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:38.751792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:38.752484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:38.759948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:38.760456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:38.760886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:38.761578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:38.762026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:38.762443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:38.836279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:38.845837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:38.847311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:38.848519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-82999e9c-7190-450b-a435-5632914834eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.101575 Aug 29 23:03:38.849170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1262/2407] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:38.868774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:38.869644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:38.870259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:38.876789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:38.877279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:38.877527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e66fb0b9-077c-45d8-8b44-f28dd806d151 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.169788 Aug 29 23:03:38.877713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:38.878128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1146/2408] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:38.878510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:38.879055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:38.879481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:39.016475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:39.025264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b3590769-e455-43e9-8d06-a5b9ad378206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159358 Aug 29 23:03:39.026125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1263/2409] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:39.871783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:39.872943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:39.879707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:39.880264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:39.880706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:39.881420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:39.881883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:39.882313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:39.886816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:39.900713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:39.901335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:39.908668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:39.909156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:39.909652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:39.910356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:39.910811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:39.911230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:39.954509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:39.963706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:39.965182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:39.967247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-daa499f4-44d9-48b5-88f7-a33aa64811f9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.098666 Aug 29 23:03:39.967247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1147/2410] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:40.047644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:40.048491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:40.052390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:40.055000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:40.055481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:40.055911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:40.056638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:40.057091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:40.057505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:40.061853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-45105ce2-ae79-44a7-b489-50f6055f6c94 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.165186 Aug 29 23:03:40.062480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1264/2411] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:40.199068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:40.208848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3172b3c4-21f3-4aa7-a4ef-0ac252926d3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165226 Aug 29 23:03:40.209437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1148/2412] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:40.989358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:40.989982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:40.996702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:40.998019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:40.998475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:40.999166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:40.999617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:41.000033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:41.068414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:41.085088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:41.085694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:41.087393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:41.088888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:41.090062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dd1b81e7-4904-4125-9910-163fd34b057a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.104619 Aug 29 23:03:41.092828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:41.093323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:41.093762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:41.094476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:41.095003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1265/2413] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:41.095183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:41.095361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:41.230745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:41.231453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:41.238459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:41.238955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:41.239403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:41.240114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:41.240605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:41.241040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:41.242706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:41.251840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-62037092-07a8-429a-b01f-8db665bba33c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170654 Aug 29 23:03:41.252468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1149/2414] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:41.383466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:41.392817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f7cf3870-0e6f-4ce8-934c-09ff975000a5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.166164 Aug 29 23:03:41.393419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1266/2415] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:42.119182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:42.119786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:42.126547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:42.127185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:42.127643 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:42.128376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:42.128820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:42.129235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:42.194853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:42.203898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:42.205428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:42.206585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-099920ee-b885-4554-901c-e5e555a48dd3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091322 Aug 29 23:03:42.207156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1150/2416] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:03:42.274016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:42.274747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:42.281957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:42.282431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:42.282861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:42.283539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:42.283987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:42.284439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:42.415564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:42.416301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:42.423414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:42.424002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:42.424495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:42.425254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:42.425709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:42.425841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:42.426154 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:42.436125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-665cb7df-e893-48c9-b1a5-42c9c1363b09 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.165928 Aug 29 23:03:42.436889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1267/2417] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:42.565391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:42.574003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e96834c2-a9b3-4ab9-9f26-3cd561812b0b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162818 Aug 29 23:03:42.574563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1151/2418] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:43.230548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:43.231070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:43.238077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:43.238570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:43.239014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:43.239730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:43.240209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:43.240637 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:43.459114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:43.459783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:43.467023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:43.467517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:43.468167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:43.468887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:43.469434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:43.469852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:43.544449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:43.553688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:43.555133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:43.557083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-339f5cd9-770e-422d-a526-1c7aa65e365f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.329967 Aug 29 23:03:43.557197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1268/2419] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:43.597010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:43.597625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:43.603803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:43.604338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:43.604778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:43.605480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:43.605940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:43.606365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:43.614755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:43.623736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-43ffffc3-3224-4f52-8c90-19d332e59b8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.168028 Aug 29 23:03:43.624701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1152/2420] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:43.628296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:43.742523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:43.761575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6c5cea86-5602-4c88-8f75-51e0e660c584 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168746 Aug 29 23:03:43.762166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1269/2421] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:44.581207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:44.581767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:44.589513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:44.589994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:44.590425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:44.591183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:44.592260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:44.592755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:44.646249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:44.646869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:44.653967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:44.654527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:44.654967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:44.655681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:44.656265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:44.656690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:44.661422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:44.672980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:44.675181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:44.676721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1f5f2e58-9abf-490b-bc3d-0427d3ab2ac8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.099289 Aug 29 23:03:44.677617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1153/2422] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:44.783339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:44.784329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:44.790433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:44.790921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:44.791377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:44.792066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:44.792540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:44.792962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:44.796236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:44.805256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cc6f5aeb-4481-46a5-903a-e5a272f656f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163110 Aug 29 23:03:44.806046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1270/2423] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:44.933398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:44.942688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-acde1228-8676-464b-957c-0bcb118872cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163435 Aug 29 23:03:44.943249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1154/2424] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:45.700999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:45.701829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:45.708339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:45.708830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:45.709267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:45.709970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:45.710427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:45.710865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:45.778470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:45.788033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:45.789500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:45.790639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2231fc8b-d5db-4db0-b245-55b45548eee1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093755 Aug 29 23:03:45.791197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1271/2425] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:45.828436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:45.829058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:45.835734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:45.836250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:45.836689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:45.837384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:45.837912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:45.838333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:45.965206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:45.965720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:45.972021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:45.972588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:45.973030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:45.973728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:45.974185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:45.974330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:45.974702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:45.983838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-47594700-e22a-4293-8d15-fdf050df7387 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.159477 Aug 29 23:03:45.984459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1155/2426] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:46.103914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:46.112858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-beeef6d6-0dd6-40f7-816f-e48ef25b310b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.151764 Aug 29 23:03:46.113427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1272/2427] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:46.814665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:46.815288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:46.821456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:46.821943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:46.822377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:46.823069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:46.823523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:46.823960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:46.889651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:46.898595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:46.900037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:46.901203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f8bdea9a-a2ba-406a-bcaa-df953c9be514 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090929 Aug 29 23:03:46.901801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1156/2428] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:47.005376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:47.005976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:47.008684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=80 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:47.014284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:47.014775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:47.015209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:47.016183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:47.016401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:47.016885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:47.133946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:47.134743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:47.136679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:47.142345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:47.142835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:47.143270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:47.143967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:47.144459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:47.150435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:47.163159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:47.171811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-191d8b0c-11d2-45a2-a0e8-d771ccd9cf79 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170254 Aug 29 23:03:47.172486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1273/2429] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:47.284030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:47.292725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bf5c1733-f53a-4d18-8ca6-9342649bacbb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162556 Aug 29 23:03:47.298589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1157/2430] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:47.927639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:47.927869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:47.934073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:47.934559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:47.934986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:47.935676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:47.936127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:47.936603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:48.000779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:48.009480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:48.010933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:48.012081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0b8e9d28-31b3-4fd4-b666-c7c34080bb6f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091169 Aug 29 23:03:48.012676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1274/2431] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:48.207058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:48.207613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:48.214345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:48.214835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:48.215276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:48.216006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:48.216506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:48.216933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:48.315940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:48.316580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:48.323337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:48.323809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:48.324276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:48.324975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:48.325427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:48.325851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:48.350267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:48.358777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6317e5e7-9fcc-49bd-94e4-4689d40dc51e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155714 Aug 29 23:03:48.359365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1158/2432] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:48.458404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:48.466509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-742949ef-4474-415f-8226-dad57360f2ca tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155562 Aug 29 23:03:48.467080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1275/2433] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:49.036170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:49.036777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:49.042737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:49.043213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:49.043642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:49.044366 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:49.044815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:49.045230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:49.110583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:49.119427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:49.120907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:49.122049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5b27a49b-66ca-4f0d-86f7-655ee34b78ce tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089851 Aug 29 23:03:49.122604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1159/2434] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:03:49.380609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:49.381277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:49.387988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:49.388580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:49.389015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:49.390322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:49.390778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:49.391197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:49.489038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:49.489694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:49.496032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:49.496541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:49.496968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:49.497652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:49.498099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:49.498518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:49.534079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:49.542982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0d35bb87-84e4-433e-b1a2-d0867c640ac7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166117 Aug 29 23:03:49.543661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1276/2435] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:49.638421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:49.646783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b5442888-e08a-48c4-ad88-1bfbce9d6054 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161534 Aug 29 23:03:49.647352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1160/2436] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:49 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:50.146439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:50.147055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:50.153186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:50.153674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:50.154112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:50.154836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:50.155298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:50.155724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:50.220120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:50.229718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:50.230620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:50.231627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ceb652be-901b-4a0f-b88f-5a595704cd6e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089321 Aug 29 23:03:50.232210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1277/2437] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:50.565031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:50.565656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:50.573565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:50.574049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:50.574484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:50.575180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:50.575631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:50.576071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:50.677100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:50.678024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:50.684557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:50.685153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:50.685645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:50.686476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:50.687078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:50.687465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:50.723079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:50.731702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0b11378a-ca12-4cde-ab9f-769420f2b54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.171485 Aug 29 23:03:50.732422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1161/2438] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:50.820102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:50.828503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6530a0c1-e420-4db2-ada3-b1f353149748 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.164258 Aug 29 23:03:50.829027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1278/2439] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:51.254349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:51.254954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:51.261195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:51.261704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:51.262137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:51.262834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:51.263280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:51.263703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:51.327777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:51.336978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:51.338454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:51.339584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-53f4c17a-f3d9-421d-a8d5-ed7b1ebf415a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089229 Aug 29 23:03:51.340370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1162/2440] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:03:51.754802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:51.755683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:51.762420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:51.762896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:51.763330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:51.764021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:51.764499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:51.764915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:51.849691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:51.850338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:51.856961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:51.857445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:51.857877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:51.858834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:51.859044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:51.859446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:51.935980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:51.945678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c797d31c-fd34-4da6-b18e-032dee1df240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.195290 Aug 29 23:03:51.946922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1279/2441] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:52.003783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:52.007405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:52.012528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0b50b4f3-2934-4593-afbe-2cc1237a6a7a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.166987 Aug 29 23:03:52.013101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1163/2442] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:52.363262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:52.363871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:52.370178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:52.370662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:52.371100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:52.371797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:52.372282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:52.372709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:52.437595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:52.447146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:52.448646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:52.449799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-20f3421f-25c7-44d1-96eb-569c174503cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091022 Aug 29 23:03:52.450395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1280/2443] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:52.968392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:52.969011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:52.976698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:52.977181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:52.977626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:52.978299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:52.978743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:52.979156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:53.038843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:53.039566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:53.046476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:53.047079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:53.047592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:53.049041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:53.049499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:53.049927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:53.123254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:53.132704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a059708e-e250-4fed-84b2-68f79ca6c18c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.168833 Aug 29 23:03:53.133289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1164/2444] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:53.184416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:53.193713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8b6bf358-8add-4858-b72c-93a3dbe7c6e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158872 Aug 29 23:03:53.194284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1281/2445] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:53.473224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:53.473754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:53.479958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:53.480484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:53.480924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:53.481620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:53.482066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:53.482489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:53.546869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:53.555773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:53.557230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:53.558368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-14790a6b-9b0f-4179-8097-7aef44a54736 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089339 Aug 29 23:03:53.558928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1165/2446] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:54.155283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:54.156470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:54.162662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:54.163152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:54.163599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:54.164337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:54.164792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:54.165215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:54.218379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:54.219269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:54.226192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:54.226677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:54.227121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:54.228068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:54.228562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:54.229194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:54.315543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:54.324129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6ca745c1-ad13-4132-8f20-a100ad7aab87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.172879 Aug 29 23:03:54.324764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1282/2447] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:54.371571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:54.380228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-31d79cb3-e03c-4596-b8de-de99ee52a848 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168974 Aug 29 23:03:54.380734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1166/2448] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:54.582921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:54.583440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:54.589967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:54.590446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:54.590877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:54.591575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:54.592019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:54.592465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:54.655563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:54.665350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:54.666807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:54.667938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4db2d5fb-de25-4ac4-81ac-1292d41f45d0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089948 Aug 29 23:03:54.668541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1283/2449] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:55.346168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:55.346745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:55.353493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:55.353981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:55.354420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:55.355146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:55.355597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:55.356023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:55.405217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:55.406338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:55.416839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:55.417712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:55.418484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:55.419738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:55.420627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:55.421430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:55.528583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:55.535806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-259b7d1e-96bf-48ca-90ed-1440f6e24e1e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.193871 Aug 29 23:03:55.536422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1167/2450] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:55.594939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:55.603947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-83370709-22fa-48b9-84fc-64eee9972e60 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.206135 Aug 29 23:03:55.604522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1284/2451] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:55.692772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:55.693394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:55.699888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:55.700397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:55.700825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:55.701512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:55.701954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:55.702370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:55.764847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:55.773884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:55.775338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:55.776593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-77383ea9-7dba-49cc-b972-d7bdfee3172c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088740 Aug 29 23:03:55.777161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1168/2452] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:55 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:56.558714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:56.559363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:56.566605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:56.567093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:56.567528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:56.568278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:56.569223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:56.569643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:56.625470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:56.626955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:56.633957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:56.634437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:56.634868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:56.635571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:56.636020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:56.636477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:56.723231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:56.731758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-10b17b1f-db7b-4b82-8f1e-4430c1a5e6bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.177032 Aug 29 23:03:56.732364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1285/2453] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:56.778305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:56.788218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-239d3cde-df01-4300-84e0-ade7d68a954f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.166504 Aug 29 23:03:56.788817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1169/2454] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:56.803123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:56.803731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:56.810507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:56.811199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:56.811823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:56.812868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:56.813764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:56.814393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:56.819055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:03:56.879689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:56.888677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:56.890163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:56.891354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8116fb48-24c4-445e-bcc6-ff90b09bfc67 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095892 Aug 29 23:03:56.892106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1286/2455] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:57.755764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:57.756415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:57.762977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:57.763464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:57.763896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:57.764627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:57.765083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:57.765508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:57.811569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:57.812322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:57.820113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:57.820627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:57.821058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:57.821752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:57.822201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:57.822620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:57.903112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:57.912524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2e2bcd48-16f7-4f1a-99e5-27a9d41dd109 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.161417 Aug 29 23:03:57.913105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1170/2456] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:57.917994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:57.918820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:57.926404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:57.927082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:57.927525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:57.928661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:57.929868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:57.930829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:57.973130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:57.981761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fd064c17-570f-4b1c-bdcf-8f2583c57b3d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.174152 Aug 29 23:03:57.982621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1287/2457] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:57.999325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:58.008712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:58.010103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:58.011287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-67f2c37c-2a68-410c-a01e-cd53e2fb26e1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097270 Aug 29 23:03:58.011867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1171/2458] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:03:58.934777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:58.935388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:58.943048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:58.943527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:58.943959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:58.944694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:58.945142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:58.945559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:59.004168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:59.004766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:59.011458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:59.011996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:59.012461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:59.013161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:59.013606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:59.014020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:59.083261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:59.091450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-891bdd4d-ad61-4ec9-86b1-b105da910379 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160548 Aug 29 23:03:59.092029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1288/2459] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:03:59.097359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:03:59.097973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:03:59.104043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:59.104563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:59.105066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:59.105771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:03:59.106225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:03:59.106657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:03:59.151736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:59.160873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2d18e36a-dbdd-4525-bcaf-c7607e2fa125 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161079 Aug 29 23:03:59.161448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1172/2460] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:03:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:03:59.169776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:59.179411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:59.180918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:03:59.182061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-72606227-ac89-45dc-aeac-7a1adb4808c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089083 Aug 29 23:03:59.182624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1289/2461] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:03:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:00.114442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:00.114998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:00.121568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:00.122037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:00.122462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:00.123138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:00.123583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:00.124167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:00.183500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:00.184246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:00.191985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:00.192621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:00.193135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:00.193924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:00.194454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:00.194953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:00.267381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:00.276556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fd4b4be0-742e-48b4-be57-3207c8ee0aa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166731 Aug 29 23:04:00.277144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1173/2462] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:00.281647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:00.282347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:00.288230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:00.288763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:00.289236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:00.289944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:00.290385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:00.290806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:00.337455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:00.345873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-19dd63f6-b9bf-4e44-8a84-119df8277cdc tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.166323 Aug 29 23:04:00.346608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1290/2463] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:00.358259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:00.367203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:00.368644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:00.369782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2ff8e909-e274-4d47-a3d5-6d464a5cbc52 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091718 Aug 29 23:04:00.370338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1174/2464] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:01.297802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:01.298345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:01.306876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:01.307914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:01.308452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:01.309515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:01.309823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:01.310498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:01.368405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:01.369016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:01.376440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:01.376929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:01.377532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:01.378464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:01.378927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:01.379348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:01.463444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:01.476861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c46db55c-0763-4851-b747-14cde1f34acb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.183211 Aug 29 23:04:01.478399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1291/2465] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:01.483823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:01.484460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:01.491823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:01.492422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:01.492930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:01.493642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:01.494099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:01.494524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:01.544219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:01.553586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3f24e24c-120e-431c-aea0-9b10e9aa8f8d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.189113 Aug 29 23:04:01.554097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1175/2466] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:01.559818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:01.569928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:01.571555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:01.572827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-879b5964-e96a-4d8d-9b75-b224bb5f2e45 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094247 Aug 29 23:04:01.573391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1292/2467] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:02.499636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:02.500361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:02.507925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:02.508438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:02.508869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:02.509559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:02.510005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:02.510433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:02.575159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:02.575773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:02.582871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:02.583372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:02.583808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:02.584561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:02.585030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:02.585451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:02.652378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:02.661854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d904ed7b-182a-4038-b6f6-27e9fd8b19cc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166003 Aug 29 23:04:02.662452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1176/2468] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:02.667332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:02.667944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:02.675369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:02.675904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:02.676566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:02.677290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:02.677751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:02.678182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:02.746326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:02.751434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:02.757130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:02.758593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:02.759748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b0af803e-e5d2-45cd-80d9-caaa3dceeddd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096370 Aug 29 23:04:02.760410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1177/2469] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:02.760564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8265ce49-d876-4a31-b337-4338128a7123 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.189112 Aug 29 23:04:02.761165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1293/2470] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:03.684399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:03.685042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:03.692627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:03.693111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:03.693552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:03.694247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:03.694701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:03.695125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:03.784701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:03.785340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:03.792328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:03.792825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:03.793263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:03.793968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:03.794502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:03.794929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:03.837448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:03.847597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-76f43fa7-161c-486d-b1fd-f58888e44e9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166952 Aug 29 23:04:03.848218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1178/2471] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:03.854859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:03.855594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:03.861949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:03.862441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:03.862870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:03.863563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:03.863779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:03.864011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:03.864615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:03.873501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:03.874948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:03.876909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3367396d-cfa2-41f7-838e-2fbe265525d2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096299 Aug 29 23:04:03.877348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1294/2472] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:03.998769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:04.007648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a68bb4cb-55a1-42e6-a7ec-2eac83e2f895 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158461 Aug 29 23:04:04.008311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1179/2473] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:04.870649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:04.871343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:04.881158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:04.881647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:04.882080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:04.882809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:04.883241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:04.883657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:04.898723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:04.899348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:04.907878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:04.909069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:04.909548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:04.910812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:04.911550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:04.912386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:04.937187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:04.988609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:04.998116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:04.999596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:05.000858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2e0ed43a-50fa-496d-b03f-923f11c8d4a6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.106036 Aug 29 23:04:05.004649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1180/2474] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:05.032652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:05.034382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:05.035170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:05.041471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:05.041949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:05.042379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:05.042913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-30dbbfad-40cf-4576-8d09-739397694117 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.176758 Aug 29 23:04:05.043099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:05.043506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1295/2475] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:05.043679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:05.043947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:05.182128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:05.191422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-16b1e74d-ad6a-4bc0-985c-f23bd119fe62 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.164458 Aug 29 23:04:05.192006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1181/2476] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:06.024523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:06.025134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:06.031613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:06.032094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:06.032562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:06.033428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:06.034125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:06.034554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:06.066892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:06.067493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:06.075372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:06.076196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:06.076704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:06.077466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:06.078012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:06.078477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:06.100488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:06.109479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:06.110956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:06.113101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e042406d-7c4c-4460-8ab2-9c9e230ada06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092442 Aug 29 23:04:06.113671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1296/2477] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:06.213719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:06.214231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:06.220757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:06.221252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:06.221691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:06.222404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:06.222859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:06.223292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:06.224349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:06.233335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a32f8a11-bfec-4ec2-ad70-093429800ff6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.171598 Aug 29 23:04:06.233938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1182/2478] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:06.360748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:06.371172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8e9b4d91-5e73-43b8-956e-30a3cd5ad01b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160204 Aug 29 23:04:06.371172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1297/2479] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:07.137501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:07.138164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:07.145375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:07.145864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:07.146302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:07.147004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:07.147459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:07.147886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:07.218713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:07.227383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:07.229019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:07.230205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-560ff57f-ea99-40a0-b772-9da26c00c5b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096790 Aug 29 23:04:07.230968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1183/2480] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:07.256464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:07.257087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:07.263843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:07.264348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:07.264790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:07.265487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:07.265944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:07.266372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:07.392282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:07.393730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:07.400742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:07.401253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:07.401688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:07.402397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:07.402854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:07.403273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:07.422297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:07.431985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-36bc55c0-976a-46b3-a69a-d2aba843cd35 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.180171 Aug 29 23:04:07.432614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1298/2481] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:07.559706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:07.569723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-afa9eff6-089d-45c5-ae8c-b779a0d29002 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.181463 Aug 29 23:04:07.570331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1184/2482] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:08.253875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:08.254421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:08.261057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:08.261635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:08.261952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:08.262630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:08.263085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:08.263501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:08.333552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:08.342616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:08.344063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:08.345246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c405b3aa-df07-41e2-bfd5-73cdfcb79446 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095586 Aug 29 23:04:08.346468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1299/2483] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:08.455654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:08.456358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:08.462824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:08.463311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:08.463750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:08.464470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:08.464926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:08.465357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:08.591068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:08.591946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:08.598616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:08.599022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:08.599589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:08.600403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:08.600871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:08.601025 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:08.601304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:08.609809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-64d2348c-bb6d-49b5-ab51-272857f76c20 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158553 Aug 29 23:04:08.610399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1185/2484] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:08.745755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:08.755261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-70510c66-c8ba-47ef-a436-481bc49c25d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168121 Aug 29 23:04:08.755853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1300/2485] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:09.369114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:09.369733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:09.376111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:09.377128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:09.377725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:09.378443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:09.378886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:09.379301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:09.446001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:09.455637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:09.457213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:09.458346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-67e669c9-2ba8-4551-aa4b-d82584dfc982 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093264 Aug 29 23:04:09.458906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1186/2486] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:09.632516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:09.633080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:09.639775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:09.640324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:09.640771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:09.641489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:09.641944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:09.642908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:09.780973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:09.782146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:09.793147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:09.793969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:09.794687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:09.796766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:09.797482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:09.798431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:09.799545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:09.809055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6ba9ea9d-8686-4012-a5fd-9813a470f3a5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.180520 Aug 29 23:04:09.809654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1301/2487] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:09 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:09.963852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:09.973448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-db4a6ee1-fada-4013-a6bf-da9b30735248 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.199442 Aug 29 23:04:09.974035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1187/2488] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:10.481707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:10.482337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:10.489405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:10.489898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:10.490336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:10.491041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:10.491499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:10.491975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:10.568755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:10.572395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:10.578279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:10.579860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:10.581158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f56e1862-9579-4d35-a553-68035e9c186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.103476 Aug 29 23:04:10.581726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1302/2489] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:10.832756 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:10.833445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:10.839896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:10.840406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:10.840837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:10.841525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:10.841973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:10.842403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:10.985286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:10.994635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4e513d06-4602-46e2-ba60-8960c7caa690 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166228 Aug 29 23:04:10.995220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1188/2490] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:11.006452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:11.007070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:11.013841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:11.014319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:11.014756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:11.015480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:11.015934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:11.016414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:11.167939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:11.184537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e8b935b4-d417-4d55-a1e5-29cf41656a93 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.187245 Aug 29 23:04:11.185541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1303/2491] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:11.604515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:11.605084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:11.612337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:11.612832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:11.613267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:11.613998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:11.614450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:11.614871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:11.684069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:11.693755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:11.695281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:11.696470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-90b1e6c1-e6a5-4c12-ba8d-e16807c4a5c1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096107 Aug 29 23:04:11.697045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1189/2492] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:12.017625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:12.018350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:12.025795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:12.026292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:12.026900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:12.027642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:12.028096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:12.028553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:12.182203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:12.191217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-850cc263-5a3e-4255-9950-69c761d606f7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.177921 Aug 29 23:04:12.191798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1304/2493] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:12.208009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:12.208772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:12.215358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:12.215825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:12.216290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:12.216991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:12.217444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:12.217907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:12.356623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:12.366842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4dbfc83b-0847-4618-b16b-0c8a2bde4539 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163337 Aug 29 23:04:12.367430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1190/2494] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:12.719980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:12.721345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:12.728281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:12.728908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:12.729392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:12.730262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:12.730819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:12.731376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:12.804918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:12.816201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:12.817924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:12.819096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8ed61307-7715-4724-9e5c-0dfb623b7a5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.103174 Aug 29 23:04:12.819656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1305/2495] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:13.213174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:13.213867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:13.221373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:13.221881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:13.222272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:13.223011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:13.223458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:13.223875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:13.363182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:13.372688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f4c8a1fb-4c9d-4a30-86cf-1dac8a2ac12d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163250 Aug 29 23:04:13.373279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1191/2496] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:13.387912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:13.389136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:13.397312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:13.397778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:13.398220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:13.399020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:13.399468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:13.399937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:13.572716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:13.582527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-233e02d0-ea43-47d2-83bf-96463e4f34eb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.198472 Aug 29 23:04:13.589244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1306/2497] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:13.848183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:13.848870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:13.857037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:13.857945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:13.857945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:13.857945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:13.859431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:13.859431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:13.967672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:13.979481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:13.980999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:13.982172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ceb1005f-c9c3-4cdb-9588-50adf0691748 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.139703 Aug 29 23:04:13.982742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1192/2498] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:14.396733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:14.397611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:14.404157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:14.404721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:14.405208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:14.406045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:14.406633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:14.407207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:14.560113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:14.569868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c9c725cf-a03a-47e1-a257-53f3206c4d1b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.177393 Aug 29 23:04:14.570571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1307/2499] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:14.616203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:14.616765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:14.623429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:14.623912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:14.624474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:14.625170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:14.625623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:14.626047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:14.770755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:14.779737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9091abc4-d040-4448-86ad-ff23d646a752 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167758 Aug 29 23:04:14.780460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1193/2500] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:15.008026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:15.009146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:15.015867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:15.016397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:15.016879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:15.018537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:15.018537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:15.018990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:15.093350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:15.108697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:15.111644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:15.113776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a177139c-27e3-4bea-9fc0-ab84ddc2ed4a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.110682 Aug 29 23:04:15.114847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1308/2501] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:15.605001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:15.605605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:15.611897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:15.612453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:15.612892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:15.613722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:15.614536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:15.615379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:15.779662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:15.788306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6018df20-a121-476b-bce9-31f78bbb9c0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.189144 Aug 29 23:04:15.788889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1194/2502] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:15.909756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:15.910375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:15.917423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:15.917967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:15.918409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:15.919119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:15.919599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:15.920027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:16.067236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:16.075925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-38b862d0-dd97-44b5-bddf-b60de6146288 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.275957 Aug 29 23:04:16.076549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1309/2503] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:16.216371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:16.216976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:16.223714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:16.224233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:16.224671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:16.225373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:16.225826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:16.226243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:16.305360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:16.325813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:16.328826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:16.331864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5f00cb23-7534-4b4f-b696-d2866ba1e8d4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.195967 Aug 29 23:04:16.332876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1195/2504] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:16.811375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:16.811991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:16.819408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:16.819894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:16.820361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:16.821101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:16.821556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:16.822047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:17.048635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:17.057422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9840f1a0-7ee7-48f5-a88a-00dadbdde3e1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.251104 Aug 29 23:04:17.058013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1310/2505] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:17.100065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:17.100870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:17.107280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:17.107759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:17.108222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:17.108914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:17.109361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:17.109776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:17.256585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:17.266271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-45df8e37-9361-4181-889b-b52d52218ce8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169971 Aug 29 23:04:17.268179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1196/2506] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:17.356605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:17.357286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:17.359358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=76 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:17.365672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:17.366170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:17.366612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:17.367334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:17.367793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:17.368284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:17.455496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:17.467724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:17.469890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:17.472110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-48779df7-ef84-4996-b1b3-1f7cdd7f0574 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.119612 Aug 29 23:04:17.472837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1311/2507] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:18.081926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:18.082633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:18.085177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=80 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:18.090453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:18.091000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:18.091474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:18.092265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:18.092759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:18.093251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:18.098533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:18.242427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:18.251063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-93e0ac1a-eeb8-4472-9758-d44d956491e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.174821 Aug 29 23:04:18.253026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1197/2508] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:18.290097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:18.290757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:18.297720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:18.298801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:18.299250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:18.299970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:18.300464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:18.300892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:18.453853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:18.464217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7fe5a9e9-d12e-4641-8db1-fc3bc415cee5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.178335 Aug 29 23:04:18.464827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1312/2509] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:18.497034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:18.497645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:18.504056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:18.504575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:18.505010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:18.505713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:18.506171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:18.506603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:18.583272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:18.593031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:18.594597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:18.596369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-70d6a4be-ce71-4841-a263-ef15513abae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.103268 Aug 29 23:04:18.596947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1198/2510] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:19.274411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:19.274971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:19.281091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:19.281570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:19.282076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:19.283289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:19.283734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:19.284172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:19.437065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:19.446777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-df8eab77-f279-4bd4-a1d3-b95ccf43a113 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.176290 Aug 29 23:04:19.447357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1313/2511] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:19.486298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:19.486965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:19.493804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:19.494289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:19.494725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:19.495419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:19.495876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:19.496346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:19.620117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:19.620752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:19.627093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:19.627675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:19.628453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:19.629370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:19.629958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:19.630507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:19.630691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:19.639474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c6df3fa4-2bd0-4096-b1d7-2d5ef6047c67 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.157104 Aug 29 23:04:19.640068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1199/2512] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:19.694593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:19.703659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:19.705700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:19.706908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-98947fe6-cfc7-4420-92cf-db57b40ddf40 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090702 Aug 29 23:04:19.707670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1314/2513] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:20.469608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:20.470857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:20.477102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:20.479485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:20.479485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:20.479485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:20.479485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:20.479870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:20.662252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:20.663124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:20.670412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:20.670901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:20.671365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:20.672105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:20.672594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:20.673258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:20.820085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:20.828428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3dafc268-2e48-48de-8e62-a8d082863abe tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170281 Aug 29 23:04:20.829056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1315/2514] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:20.840256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:20.840882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:20.847188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:20.847676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:20.848164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:20.848876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:20.849337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:20.849767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:20.872784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:20.883032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d93d6c0e-31ae-481e-bb21-50772a3f400a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.416510 Aug 29 23:04:20.883220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1200/2515] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:20.916011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:20.933248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:20.935422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:20.936928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3868cd56-07a7-4d85-bfdb-2b0c0d58dc04 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.106288 Aug 29 23:04:20.937834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1316/2516] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:21.852235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:21.853244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:21.859072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:21.864533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:21.864533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:21.864533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:21.864533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:21.864973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:21.921771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:21.923541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:21.936400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:21.937253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:21.938274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:21.939653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:21.940499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:21.941254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:22.025934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:22.035864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-73ff5183-0cd8-4b24-8501-e86ea6f8e902 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.187786 Aug 29 23:04:22.036786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1201/2517] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:22.041424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:22.042655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:22.049682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:22.050166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:22.050607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:22.051403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:22.051923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:22.052379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:22.128889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:22.129285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:22.135610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fe2fb022-0f95-42ff-be51-62695aba82e5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.220482 Aug 29 23:04:22.136332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1317/2518] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:21 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:22.136749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:22.138261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:22.139723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9ac76543-5b6c-48bb-bd1f-c0bbe4574048 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102103 Aug 29 23:04:22.140461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1202/2519] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:23.057485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:23.058106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:23.065916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:23.066437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:23.066896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:23.067600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:23.068060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:23.068522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:23.158528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:23.159426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:23.169912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:23.170789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:23.171234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:23.171973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:23.172473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:23.173403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:23.225045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:23.234233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-82bf8709-27aa-49d3-9f32-96f42f599034 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.180553 Aug 29 23:04:23.234836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1318/2520] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:23.245875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:23.246850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:23.254052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:23.254544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:23.255045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:23.255830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:23.256221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:23.256787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:23.274995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:23.316416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:23.323501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:23.325905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c1fdf173-e744-4b62-a0c5-0381bf5e3663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.171969 Aug 29 23:04:23.326579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1203/2521] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:23.333139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:23.334830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:23.336075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6415e57b-550c-4094-8fb8-c93c8d4c8a2b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.099647 Aug 29 23:04:23.336589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1319/2522] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:24.265393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:24.266078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:24.273388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:24.273858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:24.274288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:24.274968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:24.275412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:24.275827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:24.348037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:24.349315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:24.355755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:24.356270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:24.356710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:24.357407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:24.357857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:24.358278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:24.407130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:24.416316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-15ca7616-e911-4743-948a-80fd4fc2ac4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.154797 Aug 29 23:04:24.416907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1204/2523] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:24.422346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:24.422346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:24.429198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:24.429685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:24.430324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:24.431201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:24.431658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:24.432092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:24.499670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:24.499850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:24.509087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8fd8ea56-6c2f-49d3-a292-f1f32ac337ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.165293 Aug 29 23:04:24.509446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:24.509674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1320/2524] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:24.510971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:24.512119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d9553a3d-563b-4cbf-8d27-9827899e0f7b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094298 Aug 29 23:04:24.512690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1205/2525] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:25.440031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:25.440746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:25.447169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:25.447647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:25.448080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:25.449087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:25.449545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:25.449972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:25.539398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:25.540019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:25.546532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:25.547018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:25.547456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:25.548826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:25.549354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:25.549783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:25.585708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:25.594863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e169a70a-c66a-49c4-a036-17c3fbb7f556 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159619 Aug 29 23:04:25.595155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1321/2526] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:25.599949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:25.600603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:25.606826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:25.607305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:25.607743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:25.608467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:25.608924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:25.609349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:25.675146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:25.684203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:25.685645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:25.686841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4d68ba6e-966d-4ce0-a0bf-b317c0846dc5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.154589 Aug 29 23:04:25.687849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1206/2527] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:25.749619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:25.758657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f1a902a2-b5c6-44d6-b8a8-3c4ae0f8c668 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162476 Aug 29 23:04:25.759227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1322/2528] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:26.617162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:26.617703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:26.624415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:26.624906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:26.625346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:26.626134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:26.626588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:26.627013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:26.711157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:26.711776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:26.718598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:26.719088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:26.720063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:26.720970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:26.721429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:26.721859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:26.770042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:26.779029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-480260f5-63e2-43a2-aafb-6128f7a39381 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165841 Aug 29 23:04:26.779625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1207/2529] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:26.784833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:26.785439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:26.791938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:26.792450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:26.792868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:26.793565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:26.794029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:26.794424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:26.796337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:26.809734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:26.812850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:26.812850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-86c51764-bbc0-4ca7-976f-de3c11c6c56b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.105467 Aug 29 23:04:26.813591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1323/2530] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:26.939127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:26.947563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5e2e1120-4429-49af-8541-9f383bd94e9f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166895 Aug 29 23:04:26.948173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1208/2531] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:27.804688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:27.805756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:27.816988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:27.817484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:27.817926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:27.818632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:27.819098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:27.819519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:27.836937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:27.838682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:27.848506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:27.848981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:27.849412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:27.850110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:27.850545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:27.850964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:27.925620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:27.938249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:27.940625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:27.941824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d550cf7d-e12b-45fd-87a2-c1dfce2b3a94 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.109269 Aug 29 23:04:27.942428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1209/2532] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:27.970689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:27.971192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:27.971373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:27.977713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:27.978197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:27.978630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:27.979321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:27.979768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:27.980153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1b5b77e1-7557-4a6a-91a7-811402fa47e9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.182456 Aug 29 23:04:27.980276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:27.980571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1324/2533] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:28.120763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:28.129835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8feb3cbc-2d16-4318-b0ff-36a0e5853f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163225 Aug 29 23:04:28.130431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1210/2534] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:27 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:28.964953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:28.965660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:28.973137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:28.973621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:28.974057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:28.974779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:28.975211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:28.975630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:29.002507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:29.003122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:29.009551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:29.010030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:29.010474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:29.011208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:29.011665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:29.012091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:29.045015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:29.055745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:29.057389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:29.058697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8470db44-51ea-47cf-9a79-d193adb8e064 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097752 Aug 29 23:04:29.059286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1325/2535] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:29.152471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:29.153097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:29.160433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:29.160931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:29.161370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:29.162082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:29.162539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:29.162972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:29.171087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:29.180558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9b6aebd2-d254-4a75-aaaf-fe00bb0f5e74 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.182458 Aug 29 23:04:29.181160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1211/2536] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:29.318964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:29.327714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-55da41f6-3f3b-42b1-8e0e-9c58d32998d6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.179110 Aug 29 23:04:29.328408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1326/2537] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:30.082930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:30.083524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:30.090023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:30.090496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:30.090939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:30.091618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:30.092071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:30.092524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:30.154854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:30.163603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:30.165082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:30.166222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b3b39e19-c730-4c68-90d2-2d6410ee4911 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.087438 Aug 29 23:04:30.166781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1212/2538] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:30.210569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:30.211141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:30.217609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:30.218092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:30.218530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:30.219226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:30.219917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:30.220660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:30.357247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:30.357878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:30.364790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:30.365279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:30.365716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:30.366425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:30.366977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:30.367288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:30.369917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:30.383698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3c1e8fd8-77c6-41ff-a127-36d0c89a2233 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.176538 Aug 29 23:04:30.384802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1327/2539] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:30.516400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:30.520333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:30.525587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e4b4981c-ee9a-4d9b-91fe-2c14b15f3006 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.177776 Aug 29 23:04:30.526187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1213/2540] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:31.190260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:31.190781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:31.197317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:31.197807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:31.198246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:31.198983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:31.199432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:31.199860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:31.265781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:31.275413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:31.276986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:31.278142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4a14d23e-d34d-48e0-8125-e6fe54e1c49d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092369 Aug 29 23:04:31.278709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1328/2541] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:31.406945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:31.407574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:31.415273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:31.415755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:31.416211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:31.416910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:31.417357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:31.417776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:31.552555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:31.553671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:31.562052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:31.562799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:31.563251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:31.564092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:31.564744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:31.565170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:31.572081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:31.582276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a7039127-9c56-492d-9b28-f4237efd4627 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.179109 Aug 29 23:04:31.582900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1214/2542] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:31.712040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:31.721695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0570e81a-1f40-4431-964d-961b7bea2f6d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.176592 Aug 29 23:04:31.726207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1329/2543] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:32.303077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:32.303696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:32.309884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:32.310374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:32.310815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:32.311506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:32.311959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:32.312670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:32.376746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:32.386146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:32.387609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:32.388810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e06f3f98-4140-4113-9c08-6798bd9e340b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089734 Aug 29 23:04:32.389376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1215/2544] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:32.604161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:32.604727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:32.612733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:32.613240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:32.613900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:32.614683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:32.615168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:32.615733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:32.743483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:32.744222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:32.751451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:32.752060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:32.752748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:32.754302 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:32.754788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:32.755233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:32.793358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:32.804863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e7cede3a-bcd3-4f5f-ad27-8010bb101d21 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.204321 Aug 29 23:04:32.805679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1330/2545] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:32.899798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:32.909281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cf17a2d8-cc43-43cc-a717-a6f7bb039ebe tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.169665 Aug 29 23:04:32.909939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1216/2546] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:33.412796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:33.413414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:33.419706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:33.420218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:33.420657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:33.421354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:33.421808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:33.422270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:33.487131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:33.496074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:33.497610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:33.498768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2dac2b23-5c50-4bd3-9289-b3e3c2c9b210 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089928 Aug 29 23:04:33.499335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1331/2547] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:33.827682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:33.828311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:33.835889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:33.836415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:33.836845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:33.837539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:33.837985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:33.838403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:33.931594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:33.933504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:33.946829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:33.947537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:33.947868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:33.948608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:33.949134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:33.949647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:33.987234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:33.996084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-de46753f-2d1a-4706-baa6-7341b3c13df4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.172223 Aug 29 23:04:33.996713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1217/2548] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:34.108340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:34.117905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0d752da8-8c53-492d-8b2a-88c58a250776 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.190320 Aug 29 23:04:34.118525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1332/2549] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:34.523284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:34.523891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:34.530228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:34.530774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:34.531240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:34.532564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:34.533026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:34.533431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:34.612066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:34.622310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:34.623766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:34.624977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2624fdc1-f3c8-4497-9b26-f4983b571497 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.105705 Aug 29 23:04:34.625606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1218/2550] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:35.018932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:35.019754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:35.021812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:04:35.022060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:04:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 (ip 10.222.0.59) !!! Aug 29 23:04:35.024072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:04:35.024313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:04:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 (ip 10.222.0.59) !!! Aug 29 23:04:35.040938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:35.041514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:35.042022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:35.042807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:35.043373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:35.043875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:35.140179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:35.142267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:35.150386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:35.156707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:35.156707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:35.156707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:35.156707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:35.157355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:35.249801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:35.261013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6509e0ef-f3d3-40c2-b156-328a68c2611e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.246516 Aug 29 23:04:35.261807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1333/2551] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:35.351051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:35.360746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f5f65103-51e2-4e05-a31e-d4f54be88815 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.223914 Aug 29 23:04:35.361342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1219/2552] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:35.647913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:35.648541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:35.655526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:35.656002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:35.656476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:35.657702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:35.658151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:35.658571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:35.729591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:35.746693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:35.749659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:35.751920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-13d096a8-5f13-4717-8a04-153796f3f2ae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.107742 Aug 29 23:04:35.752901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1334/2553] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:36.289107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:36.289693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:36.296483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:36.296965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:36.297477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:36.298335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:36.298788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:36.299209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:36.382942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:36.383568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:36.390745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:36.391869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:36.392600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:36.393336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:36.393777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:36.394261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:36.447166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:36.456497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2c904e2c-9622-4234-bc01-12bc961f7aa7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171230 Aug 29 23:04:36.457193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1220/2554] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:36.552117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:36.560866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1193f349-17a7-4fcc-a788-5a67660f8949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.181883 Aug 29 23:04:36.561459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1335/2555] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:36.776056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:36.776701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:36.783507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:36.783988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:36.784460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:36.785151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:36.785606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:36.786018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:36.850699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:36.859612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:36.861445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:36.862602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7701defd-6955-4e19-93fb-9ba1ea95e4f5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090751 Aug 29 23:04:36.863171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1221/2556] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:37.478593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:37.479207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:37.486334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:37.487101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:37.487218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:37.487905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:37.488381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:37.488796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:37.493109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:37.583371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:37.583915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:37.590570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:37.591058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:37.591493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:37.592218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:37.592673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:37.593098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:37.628775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:37.637734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dc7bd36d-cd3d-49a7-af72-70cde195ab1d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163046 Aug 29 23:04:37.638376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1336/2557] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:37.746666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:37.755729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0297f38c-ac14-463c-8316-fdeded72e38d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.176645 Aug 29 23:04:37.756374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1222/2558] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:37.886600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:37.887228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:37.893666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:37.894152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:37.894582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:37.895461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:37.895729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:37.896173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:37.966294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:37.975931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:37.977465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:37.978801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a5735e6c-7588-469d-8d10-a0077a4fe8a8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096140 Aug 29 23:04:37.979374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1337/2559] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:38.661673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:38.662327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:38.669284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:38.669776 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:38.670204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:38.670976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:38.671344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:38.671764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:38.777469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:38.778114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:38.785670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:38.786259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:38.786706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:38.787417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:38.787870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:38.788320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:38.827079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:38.840505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9d1a75fd-b3be-4c1e-9ead-e603974eaa81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.184642 Aug 29 23:04:38.841562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1223/2560] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:38.950431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:38.963090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-82797444-e108-4a2b-9cf4-c908bb62d3aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.189112 Aug 29 23:04:38.964165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1338/2561] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:39.005675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:39.006289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:39.012999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:39.012999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:39.014146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:39.014526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:39.014985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:39.015409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:39.085106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:39.094585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:39.096457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:39.097513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-16baa4a6-a66f-4782-a7a4-8f87fe0089dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095774 Aug 29 23:04:39.098219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1224/2562] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:39.864652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:39.865268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:39.872560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:39.873105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:39.873578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:39.874334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:39.874829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:39.875294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:39.987262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:39.987873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:39.994861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:39.995430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:39.995933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:39.996685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:39.997134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:39.997553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:40.039176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:40.057349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-28402762-34d6-431d-a40d-9f30b1e40206 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.196245 Aug 29 23:04:40.058428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1339/2563] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:40.124095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:40.124894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:40.131965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:40.132587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:40.132961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:40.133677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:40.134690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:40.134690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:40.161468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:40.175250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ba74dd8c-cdd3-4f1b-9a89-319f240f0ad7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.192502 Aug 29 23:04:40.176019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1225/2564] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:40.222462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:40.231910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:40.233394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:40.234578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fce96de2-5ef8-4c13-95bd-03839298112e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.116295 Aug 29 23:04:40.235735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1340/2565] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:41.089688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:41.090452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:41.097847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:41.098338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:41.098785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:41.099630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:41.100085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:41.100650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:41.201895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:41.203103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:41.215049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:41.215927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:41.216923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:41.217962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:41.218760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:41.219612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:41.278616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:41.294172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2c109480-f0e3-41ff-beb5-f3b4c70d2f7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.208246 Aug 29 23:04:41.295266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1226/2566] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:41.303148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:41.304068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:41.313413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:41.314056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:41.314491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:41.315266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:41.315719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:41.316150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:41.383655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:41.398438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:41.401578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:41.403650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8cc83809-6441-4260-abca-993a0e9b2aae tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.106932 Aug 29 23:04:41.404758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1227/2567] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:41.431959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:41.442115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ff794bd9-b55d-493f-af44-90d2c5fe6fc0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.247763 Aug 29 23:04:41.442688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1341/2568] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:42.330838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:42.331542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:42.338038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:42.338519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:42.338950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:42.339641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:42.340092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:42.340538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:42.439556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:42.440386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:42.447205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:42.447700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:42.448179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:42.448898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:42.449361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:42.449796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:42.506555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:42.518045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-710c8ddd-ab59-4e3f-987d-41109f00d763 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.190841 Aug 29 23:04:42.518933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1228/2569] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:42.524523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:42.528120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:42.529412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:42.537101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:42.539258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:42.541066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-988736b9-0dcb-441a-b255-e8f23a98d54a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.105628 Aug 29 23:04:42.542162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:42.542500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1342/2570] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:42.543588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:42.544436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:42.545777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:42.546611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:42.547791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:42.698085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:42.707846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82bcc3f6-ad67-4852-8058-c8390ec232d0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.187389 Aug 29 23:04:42.708491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1229/2571] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:43.554102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:43.554875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:43.562176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:43.563228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:43.563678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:43.564429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:43.564890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:43.565317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:43.572061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:43.573073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:43.580243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:43.580729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:43.581263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:43.581959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:43.582407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:43.582856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:43.602739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:43.666787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:43.676716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:43.678192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:43.679370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e62746ee-d579-43a9-8141-33bfdc5894cd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.113655 Aug 29 23:04:43.679952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1230/2572] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:43.724792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:43.730096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:43.730698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:43.736160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5234fb5b-5f61-42f1-b16e-246918f6bc7e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.185560 Aug 29 23:04:43.736712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1343/2573] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:43.738147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:43.738630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:43.739062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:43.739751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:43.740243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:43.740659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:43.888495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:43.897882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-075abd8f-87d0-4c87-b541-745fc45c19ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.171619 Aug 29 23:04:43.898491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1231/2574] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:44.703783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:44.704434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:44.710839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:44.711318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:44.711754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:44.712469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:44.712931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:44.713417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:44.767140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:44.767851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:44.774644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:44.775205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:44.775446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:44.775798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:44.776625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:44.777151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:44.777644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:44.784712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:44.786145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:44.787263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-38db9fcd-7633-4704-bdb7-f0ceba656785 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.087730 Aug 29 23:04:44.787905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1344/2575] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:44.920978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:44.921629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:44.927852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:44.928244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:44.928771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:44.929205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:44.929897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:44.930351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:44.930944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:44.937373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1d6329c4-3e80-47eb-9927-167caf8ebd12 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.174009 Aug 29 23:04:44.937958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1232/2576] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:45.067044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:45.075672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0e06422a-97aa-4178-8b50-abaf747efc04 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158520 Aug 29 23:04:45.076277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1345/2577] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:45.811120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:45.811975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:45.819272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:45.819752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:45.820213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:45.820902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:45.821355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:45.821773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:45.889010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:45.898518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:45.900030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:45.901219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-49062a49-88d1-4f34-bde6-279b4d80b15f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094089 Aug 29 23:04:45.901795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1233/2578] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:45.959476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:45.960112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:45.966855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:45.967335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:45.967765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:45.968508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:45.969041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:45.969467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:46.099331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:46.099854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:46.106398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:46.106881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:46.107311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:46.108051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:46.108546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:46.108967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:46.117277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:46.125696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b62cb505-0f58-4ab9-8ecb-bb79c9a77fc1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170094 Aug 29 23:04:46.126284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1346/2579] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:46.244564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:46.253361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-97b1164b-b127-46c9-835e-be4766a3c4cf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158037 Aug 29 23:04:46.253947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1234/2580] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:46.924505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:46.925850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:46.932760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:46.933167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:46.933636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:46.934419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:46.934881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:46.935313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:47.005887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:47.014799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:47.016348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:47.017528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6522fef8-4968-4b21-8124-6b60905412f0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097317 Aug 29 23:04:47.018096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1347/2581] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:47.147843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:47.148488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:47.155367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:47.155859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:47.156894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:47.157685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:47.158147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:47.158578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:47.275481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:47.276275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:47.284018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:47.284293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:47.284590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:47.285343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:47.285798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:47.286219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:47.305328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:47.314631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac74afe1-4277-447d-a766-ebb05244146d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170695 Aug 29 23:04:47.315268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1235/2582] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:47.439155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:47.448900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e783475f-ad9a-4585-931a-0beb1e1194a2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.177537 Aug 29 23:04:47.449476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1348/2583] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:48.041053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:48.041648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:48.048431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:48.048919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:48.049348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:48.050050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:48.050613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:48.051044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:48.128915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:48.138630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:48.140101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:48.141862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e537cce9-6241-451f-aa7a-65571692392a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.104787 Aug 29 23:04:48.142445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1236/2584] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:48.339265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:48.339839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:48.342466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=76 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:48.347585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:48.348101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:48.356112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:48.356112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:48.356112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:48.356112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:48.472608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:48.473215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:48.475666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=80 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:48.481598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:48.482088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:48.482517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:48.483314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:48.483827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:48.484479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:48.506917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:48.516113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-192dceb4-ea1b-4eed-ae99-092de1cefec6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.180904 Aug 29 23:04:48.516723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1349/2585] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:48.629953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:48.638590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-80fe2a77-aa4b-4bb1-8dec-a4fae7d851f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170356 Aug 29 23:04:48.639173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1237/2586] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:49.165617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:49.166255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:49.173044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:49.173454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:49.173895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:49.174609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:49.175066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:49.175499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:49.245088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:49.254451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:49.255919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:49.257144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eaa8cba4-afc3-4a95-a2d8-cc521ede1b9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095666 Aug 29 23:04:49.257738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1350/2587] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:49.538003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:49.538702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:49.545476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:49.545971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:49.546411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:49.547119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:49.547578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:49.548005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:49.665114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:49.666250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:49.677716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:49.678562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:49.679183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:49.680051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:49.680685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:49.681301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:49.715956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:49.726329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0eef03f8-ed68-4ef3-9334-0bac2b56d488 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.192295 Aug 29 23:04:49.726917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1238/2588] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:49 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:49.839140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:49.849043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b67ac256-bfcd-442c-bbae-d75e3ce41c75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.191440 Aug 29 23:04:49.849653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1351/2589] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:50.282271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:50.283069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:50.290204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:50.290841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:50.291382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:50.292228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:50.292785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:50.293305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:50.365439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:50.375296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:50.376800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:50.377974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c276ebe4-fec3-455c-8d1a-5c92900f15d3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.100834 Aug 29 23:04:50.378538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1239/2590] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:50.747762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:50.748450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:50.755338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:50.755832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:50.756310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:50.757017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:50.757497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:50.757926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:50.873101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:50.873985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:50.881340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:50.881974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:50.882539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:50.883477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:50.884039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:50.884621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:50.910291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:50.914114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:50.920007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4822071a-f15e-4eee-a65f-06cd51ba5303 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.176005 Aug 29 23:04:50.926371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1352/2591] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:51.038622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:51.047226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f5813401-a508-4ce8-8b48-916bc985ed7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.178647 Aug 29 23:04:51.047808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1240/2592] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:51.401265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:51.401874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:51.409251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:51.409735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:51.410174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:51.410935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:51.411389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:51.411816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:51.475907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:51.486319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:51.488619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:51.489783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3b709bba-32af-4bfe-8e7d-59b8d9187ef3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092473 Aug 29 23:04:51.490351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1353/2593] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:51.944534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:51.945185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:51.951497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:51.952057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:51.952456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:51.953310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:51.954070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:51.954492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:52.068752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:52.069373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:52.075957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:52.076480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:52.076918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:52.077625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:52.078617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:52.079037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:52.097138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:52.105594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-87b24b51-3eaf-4194-be9e-7bfa442e675a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165820 Aug 29 23:04:52.106212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1241/2594] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:52.216274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:52.225236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-da91955e-a0ad-4028-ae02-4a6375679d70 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160356 Aug 29 23:04:52.225816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1354/2595] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:52.514802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:52.515397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:52.522264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:52.522752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:52.523177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:52.523908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:52.524469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:52.524894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:52.594885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:52.604051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:52.605532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:52.606682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e65ebac4-148f-4da8-9244-bb54146cbb9f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096028 Aug 29 23:04:52.607258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1242/2596] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:53.128475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:53.129137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:53.136123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:53.136651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:53.137094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:53.137835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:53.138297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:53.138727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:53.247065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:53.247770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:53.255413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:53.255901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:53.256372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:53.257075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:53.257527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:53.257952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:53.282752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:53.291211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cbe799c2-efb7-4add-98ba-f29634b70641 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167805 Aug 29 23:04:53.291792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1355/2597] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:53.395167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:53.403856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-105425b5-52cf-4c2b-b566-ee55fde19068 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160678 Aug 29 23:04:53.404499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1243/2598] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:53 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:53.630586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:53.631191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:53.637201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:53.637682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:53.638122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:53.638798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:53.639248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:53.639668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:53.702205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:53.711436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:53.712914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:53.714057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-99f94206-48bd-4592-98f8-06bcd88a35d7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.087437 Aug 29 23:04:53.714622 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1356/2599] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:54.313480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:54.314048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:54.320897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:54.321389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:54.321829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:54.322539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:54.323068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:54.323499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:54.426447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:54.427262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:54.433724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:54.434224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:54.434639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:54.435341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:54.435798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:54.436254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:54.465021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:54.480076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4e818206-77a5-4f83-b1f9-5c3406e1ffb7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170714 Aug 29 23:04:54.481159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1244/2600] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:54.588791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:54.599012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a2e6bfdd-08d6-4501-8186-bc20a357d9b3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.176528 Aug 29 23:04:54.599598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1357/2601] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:54.738440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:54.739145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:54.748787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:54.750338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:54.751129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:54.752426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:54.753249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:54.754050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:54.851351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:54.860687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:54.862127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:54.863424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4ebc6568-292e-4bc7-99e9-311e9042cab3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.130208 Aug 29 23:04:54.863984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1245/2602] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:55.503996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:55.504653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:55.511603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:55.512099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:55.512575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:55.513299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:55.513756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:55.514185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:55.621817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:55.622440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:55.630211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:55.630700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:55.631141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:55.631853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:55.632337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:55.632767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:55.681294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:55.694395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5416086a-54ec-4dc5-b5e8-e4d863f9e490 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.194886 Aug 29 23:04:55.695325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1358/2603] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:55.794301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:55.803778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-325bdb92-bbfb-423b-903b-8072031c98f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.185815 Aug 29 23:04:55.804426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1246/2604] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:55.886537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:55.887146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:55.894366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:55.894936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:55.895418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:55.896205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:55.896706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:55.897166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:55.978176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:55.990074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:55.991670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:55.992900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c9368dc6-06f3-4714-9588-531b501015fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.110366 Aug 29 23:04:55.993468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1359/2605] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:55 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:56.725370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:56.725996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:56.732698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:56.733184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:56.733620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:56.734367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:56.734819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:56.735240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:56.739506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:04:56.829712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:56.830388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:56.837069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:56.837556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:56.838025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:56.838774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:56.839232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:56.839666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:56.875585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:56.884376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-56baa8dd-c095-4c31-ac74-c5b0a9ac3671 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162765 Aug 29 23:04:56.884979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1247/2606] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:56.982257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:56.992655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1fca1752-baf6-492d-8e62-ffda3b8084a0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.167328 Aug 29 23:04:56.993216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1360/2607] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:04:57.017274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:57.017896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:57.024348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:57.024835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:57.025277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:57.025976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:57.026426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:57.026849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:57.097249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:57.106207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:57.107654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:57.109560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1e535502-149b-42af-8af4-1b751e47c77d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096353 Aug 29 23:04:57.110463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1248/2608] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:04:57.908504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:57.909206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:57.916768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:57.917265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:57.917734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:57.918451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:57.918908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:57.919342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:58.017579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:58.018942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:58.028091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:58.028990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:58.029763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:58.031162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:58.032010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:58.032803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:58.126973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:58.137202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-59e3daef-d88d-4d89-871f-7ba8a2eb4b2a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.234762 Aug 29 23:04:58.143026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1361/2609] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:58.143194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:58.143765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:58.150078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:58.150576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:58.151020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:58.151730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:58.152226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:58.152655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:58.214704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:58.228587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0fc370cb-8fb2-41b5-8c65-60335022706e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.215997 Aug 29 23:04:58.229938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1249/2610] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:58.231331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:58.250412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:58.253718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:58.256045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c8ae7e4d-2408-416e-8369-aa1751be3d0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.116818 Aug 29 23:04:58.257256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1362/2611] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:59.160406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:59.161139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:59.167623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:59.168112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:59.168580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:59.169273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:59.169731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:59.170160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:59.267477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:59.268272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:59.275085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:59.275488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:59.275930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:59.276745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:59.277205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:59.277633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:59.305710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:59.315600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0b1fbc11-ac39-4682-9ae6-b561a3917d82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160097 Aug 29 23:04:59.316226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1250/2612] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:04:59.321307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:04:59.322096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:04:59.332746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:59.333557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:59.334000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:59.334710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:04:59.335165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:04:59.335598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:04:59.408638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:59.418697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:59.420609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:59.422684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3cdfbb25-363d-41a0-87d3-e6e86d50cfe6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.105393 Aug 29 23:04:59.423572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1251/2613] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:04:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:04:59.433004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:04:59.449037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1f052987-bf3e-4245-bf34-f4d887ede453 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.185772 Aug 29 23:04:59.450105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1363/2614] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:04:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:00.344719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:00.345271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:00.352049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:00.352563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:00.353000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:00.353692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:00.354142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:00.354564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:00.459348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:00.460081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:00.467230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:00.467723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:00.468215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:00.468964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:00.469408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:00.469828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:00.500220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:00.509745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e88a4fd8-aede-4ecc-8f6a-cc6b6de23b7b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169016 Aug 29 23:05:00.519383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1252/2615] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:00.526034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:00.526668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:00.533420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:00.537836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:00.537836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:00.537836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:00.537836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:00.538759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:00.538864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:00.547128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:00.548675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:00.549846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3c52e1d8-9490-49dd-a5f5-ad3c49a53278 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095025 Aug 29 23:05:00.550420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1364/2616] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:00.683635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:00.700784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3ee63bab-4da4-4f7d-af79-2335da9b8059 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.179279 Aug 29 23:05:00.701869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1253/2617] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:01.531901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:01.532611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:01.539840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:01.540376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:01.540826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:01.541534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:01.541990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:01.542414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:01.579931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:01.580578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:01.590526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:01.591087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:01.591521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:01.592275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:01.592724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:01.593205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:01.695419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:01.705570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:01.707061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:01.708512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-457c6af1-ad45-431a-926f-1df7f2953fdd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.133986 Aug 29 23:05:01.709011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1254/2618] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:01.723531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:01.723928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:01.724197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:01.732934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f21e5486-fb07-49be-a288-c7c123fb9630 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.205258 Aug 29 23:05:01.733530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1365/2619] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:01.744365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:01.745272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:01.746058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:01.747446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:01.748346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:01.749117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:01.905205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:01.915215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9b7a4a16-708d-4b37-93ed-8a10ba641246 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.195821 Aug 29 23:05:01.915837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1255/2620] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:02.746313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:02.746878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:02.755250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:02.755687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:02.756168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:02.756563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:02.756680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:02.759266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:02.759760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:02.760217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:02.764397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:02.765069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:02.765551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:02.766261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:02.766721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:02.767144 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:02.831201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:02.843716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:02.845349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:02.846527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0cce976b-9abc-43cf-aa28-39f691216419 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.104389 Aug 29 23:05:02.847090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1366/2621] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:02.904955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:02.913527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-93b43c76-7064-46e6-b633-25450e964167 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161728 Aug 29 23:05:02.914126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1256/2622] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:02.939386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:02.939992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:02.946021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:02.946504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:02.946933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:02.947617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:02.948066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:02.948541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:03.079683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:03.088333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9d23d308-13cf-480f-804a-e7c4b4e1e3fa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.153543 Aug 29 23:05:03.088916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1367/2623] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:03.869860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:03.870487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:03.877664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:03.878142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:03.878572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:03.879289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:03.879745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:03.880188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:03.935104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:03.935738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:03.943341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:03.943840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:03.944323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:03.945037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:03.945495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:03.946616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:03.949281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:03.959848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:03.961336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:03.962524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f547a435-0fb9-41ff-8380-96eab2022cd4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096725 Aug 29 23:05:03.963085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1257/2624] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:04.082929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:04.091172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3da9a7f8-6132-4a00-8123-8410d2fa4ec9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160019 Aug 29 23:05:04.091763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1368/2625] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:04.111313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:04.111926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:04.118041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:04.118520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:04.119176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:04.119714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:04.120175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:04.120570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:04.256411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:04.265247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0fe73671-705c-47fe-a213-e477356591c5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158084 Aug 29 23:05:04.265803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1258/2626] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:04.985902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:04.986625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:04.993172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:04.993671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:04.994085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:04.994787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:04.995240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:04.995665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:05.015299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:05.067018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:05.076722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:05.078671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:05.079816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e81e4565-8f65-447a-af46-11b79cf6ee0b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097997 Aug 29 23:05:05.080406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1369/2627] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:05.113052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:05.113666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:05.120309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:05.120792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:05.121264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:05.121955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:05.122408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:05.122833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:05.258624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:05.270037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-09e9e2cb-12ba-49c5-917c-ff38c56caefa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160816 Aug 29 23:05:05.270635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1259/2628] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:05.286488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:05.287139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:05.293329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:05.293811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:05.294253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:05.294941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:05.295397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:05.296130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:05.432690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:05.442662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8efcf3a2-ecd8-42d8-8c15-e7e69f4b25f8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160035 Aug 29 23:05:05.443253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1370/2629] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:05 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:06.103670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:06.104312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:06.111486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:06.111971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:06.112435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:06.113258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:06.113832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:06.114126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:06.182401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:06.191746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:06.193238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:06.194384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-29c461ce-2a26-414d-a86d-16a7f1be9fb9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094687 Aug 29 23:05:06.194943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1260/2630] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:06.291541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:06.292181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:06.299691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:06.300285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:06.300763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:06.301466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:06.301929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:06.302356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:06.448218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:06.457496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d6d57b76-acb6-446f-ba1f-cb5141c1ab5b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169934 Aug 29 23:05:06.458087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1371/2631] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:06.464169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:06.464878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:06.471606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:06.472087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:06.472556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:06.473244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:06.473696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:06.474124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:06.609970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:06.618757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f212a56f-bf74-4a9b-a1c9-7023a8a401c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158381 Aug 29 23:05:06.619352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1261/2632] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:07.217877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:07.218395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:07.224655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:07.225140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:07.225770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:07.226511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:07.226965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:07.227382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:07.297355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:07.306559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:07.308058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:07.309283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ace6fb6d-4e20-4054-afee-986973be361f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095793 Aug 29 23:05:07.309841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1372/2633] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:07.479095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:07.479662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:07.487169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:07.487662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:07.488104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:07.488840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:07.489296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:07.489725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:07.631679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:07.640049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:07.640860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:07.642325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3c6af266-7031-4c01-aafb-dc6378789161 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167063 Aug 29 23:05:07.642932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1262/2634] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:07.647766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:07.648293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:07.648729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:07.649534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:07.649999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:07.650423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:07.789843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:07.798944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e9e1f46a-4591-4dc4-aa59-dcf8bea40be8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162682 Aug 29 23:05:07.799535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1373/2635] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:08.334187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:08.334798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:08.340961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:08.341447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:08.341887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:08.342580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:08.343033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:08.343490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:08.409734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:08.413283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:08.429809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:08.429809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:08.429809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-045c14fa-c958-42e6-9149-6a1111cf1697 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096529 Aug 29 23:05:08.430255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1263/2636] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:08.669300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:08.670108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:08.680288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:08.680934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:08.681583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:08.682498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:08.683361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:08.684158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:08.820621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:08.821236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:08.829218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:08.829817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:08.830258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:08.830700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:08.830952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:08.831404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:08.831827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:08.839806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c2a18c21-cbf7-472f-92ad-3368aceb837d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.175649 Aug 29 23:05:08.841063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1374/2637] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:08.980336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:08.990628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aeb4e3c9-c0c5-44e7-a0c6-c6f916a0e060 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.173761 Aug 29 23:05:08.995555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1264/2638] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:09.450464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:09.451071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:09.457851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:09.458342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:09.458776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:09.459468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:09.459922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:09.460380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:09.529750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:09.539001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:09.540485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:09.541665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4795e16c-397a-4317-8429-eb06b4102b41 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095308 Aug 29 23:05:09.542225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1375/2639] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:09.863703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:09.864262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:09.870835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:09.871322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:09.871758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:09.872481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:09.872933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:09.873383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:10.007532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:10.012536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:10.013153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:10.017050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac47f8d9-3932-42d0-81a0-29e8e1941037 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.157748 Aug 29 23:05:10.017839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1265/2640] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:10.020314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:10.020839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:10.021278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:10.021975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:10.022438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:10.022859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:10.163575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:10.172712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-398491cb-69c1-48c4-ac62-b60d9a641456 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163802 Aug 29 23:05:10.173333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1376/2641] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:10.565294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:10.565896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:10.572037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:10.572645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:10.573079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:10.573761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:10.574232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:10.574644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:10.644651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:10.653812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:10.655529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:10.657199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9bfe34f6-196d-41be-a055-876c2a7dac49 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096327 Aug 29 23:05:10.657757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1266/2642] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:11.039312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:11.039925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:11.046498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:11.046987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:11.047412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:11.048091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:11.048572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:11.048989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:11.184932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:11.194467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:11.195019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fbaa2e47-0d20-498e-9f69-b7cfec448fa5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159374 Aug 29 23:05:11.195153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:11.195993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1377/2643] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:11.201812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:11.202299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:11.202775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:11.203993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:11.204488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:11.204908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:11.347605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:11.356182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7b925316-1295-4290-af61-78f309ab1d97 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.165488 Aug 29 23:05:11.356781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1267/2644] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:11 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:11.680615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:11.685844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:11.688014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:11.688519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:11.688950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:11.689640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:11.690090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:11.690500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:11.756403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:11.766162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:11.767613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:11.768790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f712713a-5dff-4a0b-8183-da201e13ae71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092149 Aug 29 23:05:11.769351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1378/2645] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:12.217229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:12.217835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:12.224568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:12.225051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:12.225739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:12.226431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:12.226887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:12.227329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:12.364512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:12.373268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2b006020-dc56-4e36-ac87-ddc2fb9900a3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159805 Aug 29 23:05:12.373863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1268/2646] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:12.378517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:12.380167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:12.388821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:12.389314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:12.389759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:12.390468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:12.390978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:12.391408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:12.529855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:12.538787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2f058cd3-8c2e-4368-a6d3-c510bb84eb66 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.165469 Aug 29 23:05:12.539456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1379/2647] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:12.792383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:12.793067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:12.799920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:12.800432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:12.800873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:12.801560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:12.802014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:12.802440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:12.869462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:12.878953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:12.880456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:12.881649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-10d9df51-3a79-4b59-8ad9-61e4580050b6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093210 Aug 29 23:05:12.882252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1269/2648] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:13.395819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:13.396511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:13.403177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:13.403662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:13.404101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:13.404852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:13.405307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:13.405738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:13.560310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:13.561549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:13.562499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:13.568967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:13.569458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:13.569957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:13.571030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:13.571796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b21c04b6-bf8b-4167-bb1b-36162b6ed889 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.180523 Aug 29 23:05:13.571960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:13.572765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:13.572889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1380/2649] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:13.792387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:13.801691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-28e84ee6-c96c-4669-a460-4c424088c475 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.245254 Aug 29 23:05:13.802295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1270/2650] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:13.905837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:13.906494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:13.914551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:13.916992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:13.916992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:13.916992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:13.916992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:13.917453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:13.991306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:14.001363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:14.002835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:14.003980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d25d2433-5f1d-4dac-9922-a8bb4345be8d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102042 Aug 29 23:05:14.004713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1381/2651] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:14.594472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:14.595381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:14.602017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:14.602497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:14.602932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:14.603625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:14.604078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:14.604537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:14.745343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:14.756557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-60f992cc-e0eb-455b-bb16-9e2353df3498 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165882 Aug 29 23:05:14.757134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1271/2652] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:14.824490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:14.825147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:14.832573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:14.833100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:14.833546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:14.835012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:14.835012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:14.836352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:14.991849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:15.000603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f382f90e-93e4-436e-9d32-0e87f34ee90e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.179819 Aug 29 23:05:15.002079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1382/2653] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:15.028769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:15.029376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:15.036158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:15.036639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:15.037067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:15.037846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:15.038324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:15.038741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:15.104114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:15.114170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:15.117688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:15.117688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2435d142-89de-4979-a8b3-da4617e0868c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092123 Aug 29 23:05:15.117688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1272/2654] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:15.778069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:15.778598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:15.785176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:15.785699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:15.786138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:15.786833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:15.787291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:15.787719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:15.925861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:15.934356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2fc76584-37c3-4d7b-82f3-7c185339a059 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160275 Aug 29 23:05:15.934941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1383/2655] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:16.023153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:16.023748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:16.030790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:16.031189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:16.031615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:16.032337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:16.032787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:16.033874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:16.138828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:16.139433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:16.146350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:16.146832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:16.147328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:16.147944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:16.148420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:16.148838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:16.166924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:16.175228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-124d998e-42a9-431a-8753-9254b9767782 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155919 Aug 29 23:05:16.175940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1273/2656] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:16.214042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:16.223620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:16.225409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:16.226553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b25b81a8-b6f1-422b-9a7f-4eed23def46c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091613 Aug 29 23:05:16.227113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1384/2657] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:16.956600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:16.957163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:16.963378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:16.963872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:16.964338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:16.965047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:16.965499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:16.965950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:17.114601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:17.123886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f054e538-5e5f-47d9-bf3c-6035e54a64f9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171473 Aug 29 23:05:17.124506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1274/2658] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:17.196973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:17.197575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:17.204624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:17.205104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:17.205736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:17.206490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:17.207230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:17.207451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:17.250266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:17.250873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:17.257270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:17.259671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:17.259671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:17.259671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:17.259671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:17.260076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:17.351887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:17.362003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:17.363582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:17.364943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b79b8c79-499b-40be-bf87-7f0d9216f2f1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.118587 Aug 29 23:05:17.365603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1275/2659] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:17.370424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:17.370997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:17.377602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:17.377902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:17.378308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:17.378747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:17.379451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:17.379926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:17.380409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:17.388062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1acba912-7aab-45c4-a0f5-d0d20677fac5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.194818 Aug 29 23:05:17.393445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1385/2660] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:17.395747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] HTTP exception thrown: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Request method failure captured: Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: DELETE /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 HTTP/1.1 Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUEuuOn3fAMm-vmkfkzgy3YqCQiJSnWcAQ32q5zqpLHxaYYBd5Pnw3CWZTh9sU8mZ0Xq2svzUF921MogkriqHtKTylN0iZrPnpWanq3EHkTNtOYYe96baQ5L80gFKXUb8NsN7wPFJ8z9aSZE0U63hawbzOCRdPr5RjUlJQfnal2FyL0 Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:05:17.397522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df7ab727f89e4fcb9933c2098b4fb501", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-AttachVolumeTestJSON-127938805-project Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 43cdaa09925c4b00be3b45cea4fd40b7 Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-AttachVolumeTestJSON-127938805-project Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.399228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '19e2d0b8-7d5e-49f6-80b8-64eada460383'} Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:05:17.400098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.401520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.402888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Returning 404 to user: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:05:17.402888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-551af34e-5db7-4667-a2ce-8042f1c994db tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "DELETE /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 404 len: 111 microversion: 2.1 time: 0.032331 Aug 29 23:05:17.402888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1276/2661] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:05:17 2022] DELETE /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:05:17.409075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:17.409877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: 19e2d0b8-7d5e-49f6-80b8-64eada460383] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:17.417078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:17.417568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:17.418006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:17.418741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:17.419193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:17.419619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:17.424837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:17.435558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] HTTP exception thrown: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Request method failure captured: Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 HTTP/1.1 Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEuuOn3fAMm-vmkfkzgy3YqCQiJSnWcAQ32q5zqpLHxaYYBd5Pnw3CWZTh9sU8mZ0Xq2svzUF921MogkriqHtKTylN0iZrPnpWanq3EHkTNtOYYe96baQ5L80gFKXUb8NsN7wPFJ8z9aSZE0U63hawbzOCRdPr5RjUlJQfnal2FyL0 Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:05:17.437701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df7ab727f89e4fcb9933c2098b4fb501", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeTestJSON-127938805-project Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 43cdaa09925c4b00be3b45cea4fd40b7 Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeTestJSON-127938805-project Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.441095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '19e2d0b8-7d5e-49f6-80b8-64eada460383'} Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:05:17.442984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. Aug 29 23:05:17.445831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:05:17.447594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Returning 404 to user: Instance 19e2d0b8-7d5e-49f6-80b8-64eada460383 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:05:17.447594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-042454e3-56b7-4ac7-820f-d18007ab85f7 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383" status: 404 len: 111 microversion: 2.1 time: 0.034941 Aug 29 23:05:17.447594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1386/2662] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:17 2022] GET /compute/v2.1/servers/19e2d0b8-7d5e-49f6-80b8-64eada460383 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:05:18.146318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:18.147065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:18.153483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:18.153961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:18.154455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:18.155079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:18.155521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:18.155944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:18.287024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:18.295328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-914a4937-e603-41ea-8693-ebb760733bf5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.153480 Aug 29 23:05:18.295968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1277/2663] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:18.389982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:18.390578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:18.393092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=76 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:18.398481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:18.399032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:18.403642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:18.403642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:18.403642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:18.403642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:18.413300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:18.413912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:18.421035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:18.421523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:18.421961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:18.422653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:18.423103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:18.423523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:18.465992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:18.475926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:18.477441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:18.478598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a32d26ac-1232-4247-be31-4f15ee8ea752 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093735 Aug 29 23:05:18.479159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1387/2664] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:18.567563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:18.577895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-79875695-ade0-4a32-96a9-35256f406fe1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.168548 Aug 29 23:05:18.578485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1278/2665] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:19.318430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:19.318979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:19.325161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:19.325649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:19.326082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:19.326804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:19.327258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:19.327678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:19.466313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:19.475659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-71992e12-7a4a-4647-a5c7-ceeaaa5ca084 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161959 Aug 29 23:05:19.476256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1388/2666] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:19.504480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:19.505140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:19.507324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=84 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:19.512532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:19.513059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:19.513504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:19.514203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:19.514658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:19.515081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:19.578506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:19.587152 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:19.588642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:19.589786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-112339ad-e768-4fc3-9b29-d8788c6cb9ab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089504 Aug 29 23:05:19.590348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1279/2667] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:19.599511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:19.600118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:19.606236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:19.606711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:19.607140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:19.607822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:19.608327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:19.608740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:19.738422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:19.747023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0b562d01-d7fa-4b52-815e-e23b0ac73f4d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.151660 Aug 29 23:05:19.747617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1389/2668] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:20.497221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:20.498098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:20.504433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:20.504936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:20.505494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:20.506098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:20.506550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:20.506983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:20.613092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:20.614095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:20.620724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:20.621588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:20.622097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:20.623056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:20.623593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:20.624480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:20.646853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:20.655537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-521eaeb3-fb02-4c94-8802-a4cddd021978 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162062 Aug 29 23:05:20.656435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1280/2669] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:20 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:20.693218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:20.701998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:20.703444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:20.704601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9ed43bbc-e569-4cf2-bde4-567866199d7f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095735 Aug 29 23:05:20.705764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1390/2670] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:20.769363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:20.769972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:20.775924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:20.776450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:20.776879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:20.777563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:20.778012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:20.778432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:20.782591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:20.922590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:20.931178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6866794d-7c99-44f0-9bdc-8fe95c6b9cd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166141 Aug 29 23:05:20.931750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1281/2671] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:21.678758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:21.679377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:21.686267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:21.692046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:21.692046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:21.692046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:21.692046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:21.692454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:21.728654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:21.729272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:21.735941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:21.737012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:21.737454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:21.738150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:21.738607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:21.739036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:21.806439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:21.815973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:21.817518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:21.818693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f966b0dc-f26d-469d-8085-ce45202bcb9e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093931 Aug 29 23:05:21.819263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1282/2672] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:21.829330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:21.839519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8371ab10-74a9-4437-8d01-2930ea890d00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163061 Aug 29 23:05:21.839519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1391/2673] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:21.953361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:21.953890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:21.960067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:21.960569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:21.960997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:21.961677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:21.962117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:21.962534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:22.094110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:22.102929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eb071fc9-b4ea-4a6e-83a0-7a36b86fe56a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.153494 Aug 29 23:05:22.103502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1283/2674] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:21 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:22.841555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:22.842118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:22.848658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:22.849137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:22.849567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:22.850295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:22.850747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:22.851168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:22.859904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:22.860552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:22.867426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:22.867910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:22.868372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:22.869059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:22.869505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:22.869920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:22.915575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:22.927033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:22.928711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:22.929917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-107441b8-ba3e-4e43-b96e-269a899b7df5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092460 Aug 29 23:05:22.930514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1392/2675] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:23.021390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:23.030509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0bc08799-e82d-4b58-9344-dcd7b403c9e1 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.174311 Aug 29 23:05:23.031113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1284/2676] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:23.123223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:23.123830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:23.130317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:23.130799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:23.131234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:23.131919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:23.132402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:23.132827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:23.266339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:23.274962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d8dde0f3-ef93-4ae9-902c-978f3087c54a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155621 Aug 29 23:05:23.275541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1393/2677] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:23.953976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:23.954576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:23.962654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:23.963127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:23.963560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:23.964273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:23.964852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:23.965272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:24.031574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:24.042675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:24.044823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:24.046110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6d8c1a57-ad8f-42a2-ac01-974379f81211 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096071 Aug 29 23:05:24.046864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1285/2678] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:24.052680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:24.053348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:24.059877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:24.060398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:24.061126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:24.061816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:24.062273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:24.062708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:24.195490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:24.203844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1448754c-bdab-412a-8bf2-7393237f45aa tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155273 Aug 29 23:05:24.204450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1394/2679] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:24.296909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:24.297513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:24.303690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:24.304197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:24.304633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:24.305321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:24.305771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:24.306187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:24.447821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:24.457067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-84faf935-3742-4dfd-9a67-4e5135ddd0d9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163807 Aug 29 23:05:24.457666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1286/2680] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:25.069918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:25.070576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:25.076906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:25.077393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:25.077833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:25.078534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:25.078991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:25.079453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:25.143079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:25.151883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:25.153375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:25.154517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4479c666-c10a-4af3-a37a-b99453c64b35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088579 Aug 29 23:05:25.155077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1395/2681] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:25.225259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:25.226081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:25.232709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:25.233186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:25.233668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:25.234303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:25.234744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:25.235157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:25.368603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:25.376731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-af27c34b-8ed7-4dac-81fe-3fc163088772 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155494 Aug 29 23:05:25.377303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1287/2682] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:25.479228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:25.479757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:25.485821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:25.486302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:25.486737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:25.487419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:25.487871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:25.488574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:25.617383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:25.626075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-876aac09-c137-4576-b2aa-3e51dbb5833d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.150919 Aug 29 23:05:25.626693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1396/2683] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:26.177910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:26.178434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:26.184529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:26.185004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:26.185690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:26.186365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:26.186809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:26.187246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:26.248262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:26.256943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:26.258390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:26.259527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-455a19a5-f4c8-406e-9049-49e305d5c14a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.086405 Aug 29 23:05:26.260077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1288/2684] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:26.398543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:26.398928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:26.405703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:26.406193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:26.406632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:26.407331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:26.407790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:26.408285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:26.547523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:26.556911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-38c90df3-2ae3-434e-8558-b1893c13f057 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162550 Aug 29 23:05:26.557498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1397/2685] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:26 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:26.648607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:26.649219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:26.655439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:26.655948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:26.656422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:26.657137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:26.657590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:26.658012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:26.797094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:26.806217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fde96922-3798-4b9d-97f2-37371c3a8840 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.161994 Aug 29 23:05:26.806803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1289/2686] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:27.281582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:27.282188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:27.289021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:27.289542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:27.289979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:27.290670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:27.291122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:27.291550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:27.507243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:27.515949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:27.517431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:27.518587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-981072c2-8eaf-4764-9c9b-8e22a89ae147 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.240998 Aug 29 23:05:27.519150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1398/2687] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:27.579531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:27.580151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:27.586902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:27.587377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:27.587812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:27.588524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:27.588972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:27.589391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:27.721029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:27.730091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e4d02bd9-f4df-4633-9629-7e50aa577ade tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.154294 Aug 29 23:05:27.730682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1290/2688] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:27.829981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:27.830510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:27.838252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:27.838252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:27.838252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:27.838918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:27.839378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:27.839803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:27.978733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:27.987284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eb22a1cf-af40-44c4-bd4a-4b2676f9fd32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.161370 Aug 29 23:05:27.987843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1399/2689] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:27 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:28.542814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:28.543427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:28.549904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:28.550386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:28.550815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:28.551895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:28.552483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:28.552920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:28.618159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:28.627389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:28.629409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:28.630561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bb2d0c8b-da50-4fb9-ae35-68346eddb21d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092098 Aug 29 23:05:28.631134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1291/2690] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:28 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:28.751811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:28.752423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:28.759586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:28.760074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:28.760557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:28.761265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:28.761769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:28.762285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:28.895174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:28.903630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9ef1ed58-351d-481d-ba45-407057f5d9d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155760 Aug 29 23:05:28.904217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1400/2691] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:29.010187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:29.010671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:29.016936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:29.017489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:29.017930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:29.018628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:29.019080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:29.019694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:29.156746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:29.165997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f1673c73-df48-4d6e-99ac-2854682824b7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.159747 Aug 29 23:05:29.166604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1292/2692] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:29.653201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:29.653805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:29.661120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:29.661596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:29.662028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:29.662738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:29.663399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:29.663607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:29.730087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:29.739850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:29.741620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:29.742950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7107f30a-994c-47aa-a378-04d3303514a2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093746 Aug 29 23:05:29.743506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1401/2693] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:29.926882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:29.927595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:29.934257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:29.934743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:29.935179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:29.936125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:29.936602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:29.937037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:30.070222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:30.078491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-83d31f66-3738-48c4-bc21-2a8db09f912f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155626 Aug 29 23:05:30.079058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1293/2694] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:30.188203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:30.188854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:30.195971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:30.196524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:30.196958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:30.197648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:30.198101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:30.198521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:30.347833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:30.356731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-497de538-90ec-417f-b005-04673562032f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.173121 Aug 29 23:05:30.357327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1402/2695] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:30.768093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:30.768722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:30.774941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:30.775457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:30.775882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:30.776593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:30.777036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:30.777453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:30.838856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:30.848304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:30.849755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:30.850879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8078ddbf-789a-4db1-a838-4ebe9d0109ca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.086890 Aug 29 23:05:30.851444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1294/2696] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:31.101125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:31.101685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:31.107722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:31.108267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:31.108697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:31.109393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:31.109842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:31.110264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:31.128995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:31.251158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:31.260279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6c1cdde4-782e-4b83-80ba-1b90ed1880d3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163710 Aug 29 23:05:31.260851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1403/2697] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:31.379220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:31.379979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:31.386967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:31.387448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:31.387883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:31.388600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:31.389049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:31.389470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:31.528100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:31.537559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-714963ff-62f2-4e07-98d8-eea00d64968b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.161953 Aug 29 23:05:31.538230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1295/2698] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:31.874385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:31.875033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:31.881444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:31.881940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:31.882381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:31.883094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:31.883552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:31.883984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:31.951780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:31.962094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:31.963578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:31.964862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f9c18c57-4faa-4d62-a949-0f00df5b004e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094378 Aug 29 23:05:31.965409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1404/2699] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:32.282753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:32.283391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:32.289654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:32.290141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:32.290858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:32.291545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:32.291999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:32.292453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:32.425388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:32.434260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0c24a8b9-c793-4b87-a1f6-77e5fdfdac71 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155382 Aug 29 23:05:32.434838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1296/2700] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:32 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:32.559747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:32.560669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:32.567068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:32.567549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:32.567986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:32.569447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:32.569902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:32.570327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:32.702981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:32.711462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-57fc26ce-da0d-4a96-8d4d-8134b3e73281 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155831 Aug 29 23:05:32.712030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1405/2701] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:32.987674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:32.988316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:32.994949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:32.996063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:32.996063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:32.996552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:32.997016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:32.997421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:33.062682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:33.066166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:33.071824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:33.073306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:33.074454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8f388b2e-2c09-42e0-9f47-157eb67cbd59 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090740 Aug 29 23:05:33.075010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1297/2702] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:33.457672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:33.458287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:33.464847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:33.465333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:33.465768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:33.466456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:33.466915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:33.467333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:33.595945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:33.605164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c2bca23b-4da8-4c7c-86bc-3e6e962fe10b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.151303 Aug 29 23:05:33.605733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1406/2703] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:33.733438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:33.733991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:33.741277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:33.741779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:33.742225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:33.742916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:33.743369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:33.743793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:33.878375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:33.887474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-44887014-cc42-4d53-98c5-db228c2161bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158298 Aug 29 23:05:33.888055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1298/2704] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:34.097212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:34.097734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:34.104376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:34.104861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:34.105298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:34.105997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:34.106455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:34.106884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:34.168991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:34.177723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:34.179184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:34.180386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c5dc9073-197c-4700-bd87-a22ae513d6cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.087210 Aug 29 23:05:34.180946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1407/2705] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:34.626607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:34.627212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:34.633843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:34.634322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:34.634752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:34.635440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:34.635887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:34.636344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:34.771731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:34.780664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1312f852-cf24-429e-a897-426be113f03d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.157766 Aug 29 23:05:34.781257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1299/2706] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:34.909468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:34.910225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:34.917431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:34.917926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:34.918442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:34.919200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:34.919662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:34.920098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:35.060935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:35.069180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f2838d74-d95f-4803-88c7-4f9f40225865 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163642 Aug 29 23:05:35.069755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1408/2707] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:35.205062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:35.205666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:35.211607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:35.212074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:35.212656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:35.213369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:35.213810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:35.214243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:35.278101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:35.286717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:35.288194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:35.289332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c40ddcb9-81dd-4338-9a31-cb34ccdb9de0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088257 Aug 29 23:05:35.289902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1300/2708] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:35.802555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:35.803170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:35.809281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:35.809799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:35.810489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:35.811177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:35.811626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:35.812049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:35.945862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:35.955279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-08135588-7ab0-4933-87a2-f8ebe94f3a3a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.157215 Aug 29 23:05:35.955864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1409/2709] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:36.090979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:36.091544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:36.097888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:36.098366 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:36.098794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:36.099466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:36.099915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:36.100368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:36.238321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:36.247008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8f56e010-825e-4e30-9f9a-604c2fe568d1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160079 Aug 29 23:05:36.247584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1301/2710] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:36.312583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:36.313189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:36.319372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:36.319943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:36.320489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:36.321250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:36.322265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:36.322695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:36.386384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:36.395181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:36.396675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:36.397823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-369d151f-034b-47a2-8e88-a7c03962d1e0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089510 Aug 29 23:05:36.398383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1410/2711] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:36 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:36.977543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:36.978829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:36.984991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:36.985477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:36.985923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:36.986610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:36.987060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:36.987484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:37.124557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:37.132897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-454c2632-a6ea-4be2-b0a6-da667890d80b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159223 Aug 29 23:05:37.133483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1302/2712] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:37.269588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:37.270219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:37.277678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:37.278237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:37.278706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:37.279431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:37.279897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:37.280393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:37.417881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:37.420619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:37.421235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:37.426641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f2720817-7cd5-439d-a41a-6acc0b68415b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160924 Aug 29 23:05:37.427212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1411/2713] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:37.428118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:37.428626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:37.429060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:37.429758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:37.430251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:37.430669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:37.498198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:37.506759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:37.508251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:37.509930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-20fda217-3828-46fb-8767-031eb3c595c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093253 Aug 29 23:05:37.510494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1303/2714] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:38.154470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:38.155120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:38.162111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:38.162604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:38.163053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:38.163778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:38.164287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:38.164716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:38.300476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:38.309326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d6e29a30-aa54-4910-8cb7-cc470ca043af tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158887 Aug 29 23:05:38.309899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1412/2715] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:38 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:38.451812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:38.452501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:38.459033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:38.459521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:38.459955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:38.460682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:38.461131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:38.461551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:38.532718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:38.533411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:38.539514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:38.540002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:38.540475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:38.541188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:38.541650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:38.542067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:38.601056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:38.609646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5f6e48d7-df9e-43f5-a8a6-47510770418e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163089 Aug 29 23:05:38.610204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1304/2716] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:38.611243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:38.620953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:38.622410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:38.623568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c2ad30a6-ca6d-494b-a3fe-af6ab187df03 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095199 Aug 29 23:05:38.624125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1413/2717] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:39.331718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:39.332276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:39.339487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:39.340022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:39.340529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:39.341365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:39.341953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:39.342487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:39.487758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:39.496418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5940f708-4dfe-45f7-962a-719a1f646ca5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168630 Aug 29 23:05:39.497063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1305/2718] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:39.641750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:39.642354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:39.649576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:39.650888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:39.651849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:39.652663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:39.653361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:39.655078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:39.655865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:39.656631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:39.661676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:39.662462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:39.663170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:39.664215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:39.664722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:39.665245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:39.738075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:39.747819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:39.749493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:39.750744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-28a91937-1bba-4ecd-b0a7-819a7d96c181 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.106623 Aug 29 23:05:39.751342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1306/2719] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:40.039565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:40.048250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c13cfd1a-f8a1-48f1-8907-fd68165bc8a7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.410574 Aug 29 23:05:40.048828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1414/2720] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:40.518179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:40.518797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:40.526286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:40.527187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:40.527614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:40.528345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:40.528807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:40.529286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:40.674861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:40.684862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cc72bd4f-60f9-41e8-8da1-e018b358195c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170430 Aug 29 23:05:40.685733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1307/2721] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:40.774543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:40.775194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:40.782890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:40.783383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:40.783827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:40.784589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:40.785047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:40.785474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:40.852806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:40.862585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:40.864040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:40.865252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-64ee1473-b0c1-4ed3-8fb1-da012184e01f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094872 Aug 29 23:05:40.865817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1415/2722] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:41.071006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:41.071529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:41.078479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:41.078983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:41.079402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:41.080087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:41.080562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:41.080983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:41.215005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:41.223861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-18d99c65-e161-4f87-bafe-d2f156879dc5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.156819 Aug 29 23:05:41.224500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1308/2723] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:41.707910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:41.708551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:41.714899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:41.715384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:41.715822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:41.716578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:41.717052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:41.717481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:41.858712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:41.867171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5bd3bbda-562d-4c22-895e-f237c4b039a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163547 Aug 29 23:05:41.867735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1416/2724] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:41.898207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:41.898804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:41.905392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:41.905865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:41.906289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:41.907011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:41.907495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:41.907943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:41.977047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:41.988645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:41.990145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:41.991289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-168e8307-0320-4cb0-b64e-f0fc65da0e99 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097067 Aug 29 23:05:41.991866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1309/2725] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:42.245427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:42.245949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:42.252182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:42.252671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:42.253111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:42.253804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:42.254262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:42.254690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:42.387255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:42.395682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a2fc2a97-966e-451b-b05a-6bd4a1cd02c9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.154478 Aug 29 23:05:42.396293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1417/2726] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:42.890757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:42.891841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:42.899791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:42.900419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:42.900778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:42.901802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:42.902071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:42.902496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:43.015826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:43.016596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:43.025047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:43.025548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:43.026046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:43.026783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:43.027256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:43.027922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:43.060755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:43.071147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7fb6b60e-2cf3-4752-a092-38aa6fcf5e42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.185093 Aug 29 23:05:43.074344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1310/2727] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:43.099366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:43.109691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:43.111172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:43.112543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-be87ee45-369c-4058-96e0-276f337738b0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.100738 Aug 29 23:05:43.113117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1418/2728] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:43.419016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:43.419635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:43.426095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:43.426614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:43.427046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:43.427775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:43.428257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:43.431684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:43.570058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:43.578790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ff2221bf-5eeb-46a6-8bf4-6ea2d0350b2e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.164212 Aug 29 23:05:43.579385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1311/2729] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:44.095679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:44.096351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:44.102844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:44.103309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:44.103749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:44.104680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:44.104953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:44.105460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:44.135139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:44.136254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:44.142720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:44.143197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:44.143628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:44.144415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:44.144858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:44.145273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:44.211798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:44.222272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:44.223730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:44.224933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e635e108-7585-415d-abcd-99e7985e54bd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093713 Aug 29 23:05:44.225514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1312/2730] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:44.243072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:44.252204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f02d73fb-2854-4a9f-b369-88f7e0ff431f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160322 Aug 29 23:05:44.252785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1419/2731] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:44 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:44.605173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:44.605691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:44.611871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:44.612385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:44.612873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:44.613551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:44.613999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:44.614416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:44.749009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:44.757477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b95f0092-7142-41c0-9b5a-904491c15174 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.156384 Aug 29 23:05:44.758057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1313/2732] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:45.248256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:45.248788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:45.255361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:45.255837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:45.256298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:45.256987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:45.257473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:45.257916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:45.262222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:45.273898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:45.275509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:45.282520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:45.283007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:45.283439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:45.284151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:45.284620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:45.285043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:45.305947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:45.329433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:45.341255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:45.342880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:45.344107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-217cdbb0-635e-4995-8e2f-2b5eb649b095 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.099998 Aug 29 23:05:45.344702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1420/2733] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:45 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:45.434156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:45.447622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c373c086-9987-4d8f-afe9-8d3210f9d096 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.177617 Aug 29 23:05:45.448296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1314/2734] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:45.779511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:45.780126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:45.786216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:45.786704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:45.787151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:45.787855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:45.788347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:45.788781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:45.921090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:45.929902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-13ece7c4-7a57-4489-b2c1-53172e3f3fc1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.154696 Aug 29 23:05:45.930492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1421/2735] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:46.368356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:46.368966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:46.376416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:46.376931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:46.377369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:46.378061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:46.378510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:46.378935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:46.449465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:46.458367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:46.459888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:46.461051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3eb27fcd-d847-428d-b9e7-f32dff26f9d6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096649 Aug 29 23:05:46.461618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1315/2736] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:46.469744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:46.470406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:46.477076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:46.477558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:46.477987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:46.478677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:46.479127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:46.480071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:46.619633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:46.629246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cd8d0099-0181-4f7b-882e-87dfccf743c6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163341 Aug 29 23:05:46.634364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1422/2737] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:46 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:46.953082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:46.953719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:46.960065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:46.960582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:46.961013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:46.961717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:46.962160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:46.962577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:47.103930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:47.115400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3d73571e-e192-49d9-90ac-346cd8157b69 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166898 Aug 29 23:05:47.116075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1316/2738] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:47.484688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:47.485253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:47.492499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:47.492995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:47.493440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:47.494157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:47.494624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:47.495054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:47.566501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:47.575928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:47.577440 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:47.578613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-48a16aa9-1b93-41fe-8889-5777b5ea38e4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.098861 Aug 29 23:05:47.579176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1423/2739] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:47.654934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:47.655564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:47.662338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:47.662822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:47.663254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:47.663947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:47.664416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:47.664836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:47.809407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:47.818492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-edcca93e-6d9d-4fca-82aa-45e700869279 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168243 Aug 29 23:05:47.819083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1317/2740] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:48.138619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:48.139233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:48.145615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:48.146144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:48.146615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:48.147314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:48.147764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:48.148221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:48.305832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:48.315224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fe4cee2b-9cdc-42d3-9b38-5ccff493be03 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.181521 Aug 29 23:05:48.315841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1424/2741] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:48.602789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:48.603415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:48.610090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:48.610576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:48.611015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:48.611717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:48.612206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:48.612627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:48.681467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:48.693276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:48.695032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:48.695965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b33fb600-f549-4528-a993-520d12487807 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097299 Aug 29 23:05:48.696566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1318/2742] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:48.840478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:48.841082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:48.843439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=76 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:48.848370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:48.848859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:48.849307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:48.850013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:48.850472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:48.850900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:48.995908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:49.005052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1dc9d58a-2c53-48e1-9a69-50581e808043 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168607 Aug 29 23:05:49.005637 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1425/2743] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:49.337139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:49.337644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:49.344177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:49.344669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:49.345102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:49.345796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:49.346236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:49.346656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:49.491175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:49.500855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-515e600e-885e-4b31-9e19-4e7b59038ac9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.167681 Aug 29 23:05:49.501447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1319/2744] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:49.720410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:49.721084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:49.727455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:49.727938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:49.728405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:49.729107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:49.730114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:49.730540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:49.796865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:49.810702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:49.813782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:49.816179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-aa69c6b0-814c-4437-ba26-b9589503b1a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.099546 Aug 29 23:05:49.817238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1426/2745] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:50.028814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:50.029833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:50.032966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=82 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:50.037944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:50.049890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:50.049890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:50.049890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:50.049890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:50.050639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:50.182310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:50.192290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dcbee392-8eed-408e-94bb-6f7d704a1b42 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168235 Aug 29 23:05:50.192883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1320/2746] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:50 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:50.523059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:50.523669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:50.530514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:50.530999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:50.531461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:50.532190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:50.532647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:50.533289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:50.691547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:50.696037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5307a6be-0574-4b99-b5a5-8508cf114702 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.177029 Aug 29 23:05:50.696683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1427/2747] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:50.843652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:50.844292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:50.856458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:50.856458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:50.856458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:50.856458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:50.856916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:50.856916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:50.921275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:50.930602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:50.932064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:50.933970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bd73c520-aff7-45c9-b67d-c3f94c861503 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095034 Aug 29 23:05:50.934545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1321/2748] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:51.217348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:51.218040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:51.226273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:51.226784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:51.227217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:51.227916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:51.228400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:51.228826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:51.366749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:51.375333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e74f152a-d1bf-437a-93eb-0b4221fb2cef tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163982 Aug 29 23:05:51.375904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1428/2749] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:51.718857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:51.719497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:51.726800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:51.727283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:51.727707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:51.728514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:51.728989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:51.729562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:51.866109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:51.875872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2ba88fba-bce6-445b-955c-f42b14c9d7cd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.161752 Aug 29 23:05:51.876906 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1322/2750] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:51.957625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:51.958256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:51.964828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:51.965343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:51.965785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:51.966481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:51.966939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:51.967385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:52.032519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:52.042296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:52.043974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:52.045331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1278ecb4-288c-49b0-8835-bae8ca3bc88c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091785 Aug 29 23:05:52.046772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1429/2751] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:52.401910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:52.403065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:52.411065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:52.411550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:52.411974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:52.412699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:52.413475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:52.413603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:52.549822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:52.558972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e7e42cc8-b173-401a-bdd9-c9e2f88ef6f3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.164486 Aug 29 23:05:52.559809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1323/2752] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:52.900342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:52.900962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:52.907864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:52.908388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:52.908837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:52.909559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:52.910027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:52.910459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:53.052930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:53.063066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-15693f45-2555-4803-8df4-cbea6ee61c00 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166605 Aug 29 23:05:53.063638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1430/2753] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:53.069207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:53.069995 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:53.077497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:53.078449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:53.079169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:53.079546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:53.079991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:53.080432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:53.150721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:53.159626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:53.161150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:53.162311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-453b4d9a-11ed-4d06-91b4-34a6c7cf9279 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097137 Aug 29 23:05:53.162874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1324/2754] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:53.580733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:53.581282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:53.587390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:53.587878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:53.588352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:53.589568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:53.590028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:53.590459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:53.726434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:53.735457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-80e6e8ac-5733-4271-9b40-854cc2e6c8d8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158726 Aug 29 23:05:53.736032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1431/2755] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:54.084909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:54.085505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:54.092638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:54.093122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:54.093581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:54.094273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:54.094724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:54.095149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:54.185887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:54.186491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:54.192379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:54.192868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:54.193296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:54.193985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:54.194434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:54.194857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:54.230012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:54.238746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ebf6d442-70e5-485b-bc0b-e5ad15acd488 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157764 Aug 29 23:05:54.239607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1325/2756] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:54.262699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:54.275485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:54.277926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:54.279080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-473dc67f-4ca6-4c13-b179-f7659cb6a89b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097658 Aug 29 23:05:54.279648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1432/2757] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:54.757771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:54.758405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:54.766564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:54.767071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:54.767519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:54.768298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:54.768766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:54.769197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:54.931877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:54.942320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2e25d454-961f-4473-bdd5-f81c6c4f585f tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.188499 Aug 29 23:05:54.942923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1326/2758] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:55.260848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:55.261495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:55.268031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:55.268544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:55.268968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:55.269657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:55.270104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:55.270523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:55.302836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:55.303424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:55.310648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:55.311134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:55.311568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:55.312291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:55.312745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:55.313169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:55.394312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:55.404240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:55.406351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:55.406916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5746aec7-5c8f-4981-9378-ebd20e4bf67b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.108050 Aug 29 23:05:55.407489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1327/2759] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:55 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:05:55.420654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:55.429733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1b42fdae-d1c0-40f8-ac86-a1cf8f5f08a6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.173121 Aug 29 23:05:55.430323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1433/2760] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:55.976963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:55.977615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:55.984784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:55.985271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:55.985710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:55.986421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:55.986877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:55.987296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:56.133163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:56.142317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-38a373d6-ff01-4d5a-962d-7d075b8ad160 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169272 Aug 29 23:05:56.142916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1328/2761] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:56.432016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:56.432902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:56.440357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:56.440884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:56.441320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:56.442012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:56.442507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:56.442931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:56.453114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:56.453722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:56.460689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:56.461185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:56.461612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:56.462316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:56.462765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:56.463180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:56.508927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:56.518161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:56.519633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:56.520829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4afa39f3-4ffe-40b4-af11-c9ef6fcc9224 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093552 Aug 29 23:05:56.521397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1434/2762] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:56.602909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:56.611975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-12601462-6842-4dee-bf7a-66bdbac055bc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162646 Aug 29 23:05:56.612573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1329/2763] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:57.163990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:57.164660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:57.171049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:57.171474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:57.171914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:57.172645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:57.173109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:57.173542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:57.310073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:57.318933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c25fc564-714f-4f49-89c6-0fc999adeb66 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158773 Aug 29 23:05:57.323757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1435/2764] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:57 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:57.553231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:57.553804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:57.561826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:57.562360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:57.562830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:57.563606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:57.564092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:57.564608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:57.632346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:57.633359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:57.633972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:57.641728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:57.642171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:57.642316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:57.642642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:57.643351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:57.643642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:57.643788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:57.644264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:57.644969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-36cf37d7-5793-42b4-bfd7-fdfbd02b2102 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.104402 Aug 29 23:05:57.645550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1330/2765] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:57.785846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:57.789376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:57.794934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-32d00257-cda7-44f4-96d5-6923f1237918 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.165500 Aug 29 23:05:57.795522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1436/2766] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:05:58.342078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:58.342599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:58.348803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:58.349293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:58.349732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:58.350450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:58.350944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:58.351375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:58.356556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:05:58.491753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:58.500594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ecd8ba6a-d320-49ac-8955-6e22f55440e2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162346 Aug 29 23:05:58.501206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1331/2767] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:58.670336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:58.670953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:58.678277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:58.678760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:58.679191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:58.679897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:58.680382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:58.680802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:58.747261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:58.756537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:58.758010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:58.759158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5e417f43-b012-452c-9f05-da2cbb70160d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094048 Aug 29 23:05:58.759714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1437/2768] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:58.817052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:58.817686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:58.824223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:58.825195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:58.825623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:58.826307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:58.826763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:58.827177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:58.963000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:58.971627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-719d8e1b-f79a-4d78-9a3a-bda48a1595bd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158678 Aug 29 23:05:58.972234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1332/2769] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:59.526638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:59.527245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:59.533708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:59.534209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:59.534655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:59.535363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:59.535821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:59.536297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:59.678523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:59.688162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-18498496-025f-4568-8f8b-b9cce9213dfd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169844 Aug 29 23:05:59.688911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1438/2770] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:05:59.783338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:59.783841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:05:59.790194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:59.790678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:59.791110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:59.791848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:05:59.792340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:05:59.792767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:05:59.861005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:59.870069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:59.872284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:05:59.873613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fcb95e9b-68a5-43c7-9d82-83f0593d727f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094376 Aug 29 23:05:59.874186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1333/2771] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:05:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:05:59.994035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:05:59.994656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:00.001379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:00.001864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:00.002300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:00.003146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:00.003618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:00.004075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:00.142522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:00.151228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4c1d78b7-67b1-46b2-a18c-3e5370146091 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.161129 Aug 29 23:06:00.151811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1439/2772] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:05:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:00.709914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:00.710440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:00.717414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:00.717897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:00.718336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:00.719038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:00.719492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:00.719951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:00.897779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:00.898457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:00.906535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:00.907033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:00.907481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:00.908235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:00.908702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:00.909136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:00.978274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:00.988745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:00.990270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:00.991461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-955854e5-ec37-417d-8e9a-43b794568fca tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097789 Aug 29 23:06:00.992654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1440/2773] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:01.093527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:01.102177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e85b6b30-4ff4-4365-ab61-49c4b5be666a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.396283 Aug 29 23:06:01.102751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1334/2774] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:01.172725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:01.173346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:01.179408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:01.179888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:01.180372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:01.181049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:01.181522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:01.182025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:01.322635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:01.331432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a7ce985d-f271-4e03-918b-37d9ddd4bc7a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162708 Aug 29 23:06:01.331997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1441/2775] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:02.015328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:02.015935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:02.022722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:02.023573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:02.024315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:02.025033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:02.025491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:02.025922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:02.101978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:02.111621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:02.113085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:02.114232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-274715d5-9f61-45e8-8238-4a1b49e26e0f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.103042 Aug 29 23:06:02.114926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1335/2776] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:02.124713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:02.125321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:02.133771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:02.134266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:02.134708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:02.135424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:02.135908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:02.136369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:02.279851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:02.290983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dfdb2c64-8659-4688-ada1-30433abbbf49 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170938 Aug 29 23:06:02.291576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1442/2777] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:02.354227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:02.354797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:02.362395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:02.362876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:02.363314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:02.364014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:02.364514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:02.364968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:02.524848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:02.533792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dc3b4ebb-ca5e-492e-9d37-02a5b424950e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.183732 Aug 29 23:06:02.534369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1336/2778] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:03.140004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:03.140658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:03.147525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:03.148006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:03.148474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:03.149169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:03.149623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:03.150079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:03.218580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:03.227589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:03.229087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:03.230275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a2bd3f98-71ca-4a85-ad84-50079ccb5ee6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094843 Aug 29 23:06:03.230860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1443/2779] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:03 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:03.314264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:03.314866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:03.322143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:03.322786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:03.323248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:03.323950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:03.324428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:03.325471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:03.464781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:03.473204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-13824d44-0736-4b64-ae06-0b69bc756953 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163889 Aug 29 23:06:03.473780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1337/2780] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:03 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:03.555333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:03.555949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:03.563331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:03.563833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:03.564307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:03.565020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:03.565485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:03.565917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:03.727945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:03.737659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6ec3d7f6-438f-4688-aa11-36a4144bf84b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.186394 Aug 29 23:06:03.738257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1444/2781] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:04.253826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:04.254429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:04.261023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:04.261505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:04.262462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:04.263359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:04.263809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:04.264259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:04.333756 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:04.343992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:04.345495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:04.346677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-063571f3-0808-4fe8-8899-6f456d125ca1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096873 Aug 29 23:06:04.347306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1338/2782] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:04.498625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:04.499283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:04.506479 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:04.506884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:04.507321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:04.508023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:04.508515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:04.508939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:04.656525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:04.665281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-51c61651-b61c-4adb-827a-c60dea8e686e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.173492 Aug 29 23:06:04.665870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1445/2783] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:04.761852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:04.762661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:04.769076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:04.769653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:04.770096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:04.770815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:04.771273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:04.771704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:04.920223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:04.931089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-40c8aabd-dd0e-440e-a4b0-91acafd9ae0a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.173129 Aug 29 23:06:04.931909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1339/2784] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:05.370074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:05.370835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:05.378060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:05.378551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:05.378987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:05.379703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:05.380220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:05.380683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:05.450075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:05.460214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:05.461766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:05.462980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-93c856d6-d968-4f57-9cb9-98282f1c474a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096972 Aug 29 23:06:05.463578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1446/2785] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:05.688722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:05.689278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:05.695733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:05.696246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:05.696679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:05.697366 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:05.697812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:05.698232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:05.843437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:05.852482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9de46b8d-7f3e-483a-ae3d-fa46bd45007e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168469 Aug 29 23:06:05.853086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1340/2786] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:05.954458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:05.955035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:05.961903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:05.962390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:05.962830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:05.963540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:05.964007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:05.964645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:06.123803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:06.132541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6c8db895-630f-485e-94bd-234420f734dd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.182750 Aug 29 23:06:06.133137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1447/2787] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:05 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:06.493421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:06.494202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:06.501307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:06.501791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:06.502222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:06.502913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:06.503359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:06.503778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:06.568304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:06.577923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:06.579372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:06.580714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6d0859d5-858f-4ecb-82c9-f1e2376d477f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091165 Aug 29 23:06:06.581283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1341/2788] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:06.875054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:06.875662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:06.881922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:06.882407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:06.882845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:06.883543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:06.883993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:06.884442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:07.020766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:07.030257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-46ff3318-13b6-4c39-a026-0947bf6cddf7 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159334 Aug 29 23:06:07.030872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1448/2789] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:07.155341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:07.155893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:07.162958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:07.163447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:07.163887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:07.164609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:07.165061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:07.165481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:07.314481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:07.323590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f002ea7d-c05d-41ef-913f-af41ec99b94d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.173207 Aug 29 23:06:07.324263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1342/2790] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:07.603002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:07.603600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:07.610204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:07.610819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:07.611378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:07.612438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:07.612939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:07.613414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:07.677081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:07.686984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:07.688491 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:07.689646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-944a40e1-3991-452b-8f62-82a4994f2794 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090656 Aug 29 23:06:07.690205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1449/2791] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:08.052632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:08.053285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:08.061176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:08.061717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:08.062209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:08.062940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:08.063417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:08.063853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:08.199487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:08.208493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-23c070a0-83b9-4099-8a46-e78c66d9ca3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.159672 Aug 29 23:06:08.208753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1343/2792] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:08.346358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:08.346979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:08.353580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:08.354065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:08.354569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:08.355272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:08.356562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:08.357012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:08.503211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:08.512004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-54f534fe-de82-4a37-a210-e8f188b66f81 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.169415 Aug 29 23:06:08.512989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1450/2793] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:08.717209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:08.717735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:08.724026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:08.724527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:08.724961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:08.725650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:08.726094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:08.726517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:08.794319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:08.803375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:08.804925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:08.806098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-587b821a-9ad1-4b7e-b59b-1eed620b41a9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093806 Aug 29 23:06:08.806668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1344/2794] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:09.230078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:09.230746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:09.236700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:09.237184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:09.237640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:09.238322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:09.238792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:09.239195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:09.373648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:09.382183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e0f7b22a-e456-4c43-8564-a516c4b1866c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155889 Aug 29 23:06:09.382752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1451/2795] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:09.533829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:09.534368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:09.540921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:09.541399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:09.541820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:09.542504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:09.543653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:09.543944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:09.701840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:09.710596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ba54531e-ae3a-44ce-ba91-6e4524989af1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.180642 Aug 29 23:06:09.711185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1345/2796] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:09 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:09.829234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:09.829778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:09.835799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:09.836340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:09.836797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:09.837477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:09.837921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:09.838339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:09.905053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:09.914720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:09.916272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:09.917538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3baac33c-ea0a-4a4c-bed6-5e468d2a9753 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092251 Aug 29 23:06:09.918039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1452/2797] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:10.404187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:10.404866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:10.411134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:10.411623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:10.412059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:10.412792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:10.413241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:10.413661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:10.552541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:10.562456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b34aff4d-3b82-4244-9f4e-650d4b489a56 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163152 Aug 29 23:06:10.562949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1346/2798] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:10 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:10.734038 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:10.734749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:10.742693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:10.743193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:10.743654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:10.744418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:10.744883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:10.745329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:10.780468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:10.914110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:10.923881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-84bace5e-8abb-4fe9-a885-f06b5dd93c9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.193879 Aug 29 23:06:10.924551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1453/2799] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:10.941760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:10.942367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:10.949009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:10.949545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:10.950132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:10.950819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:10.951315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:10.951730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:11.035473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:11.041722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:11.053324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:11.055827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:11.058071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-50201104-8af7-4d95-ab32-4bde4b96beb0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.119948 Aug 29 23:06:11.060133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1347/2800] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:11.584769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:11.585400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:11.592425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:11.592924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:11.593363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:11.594068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:11.594524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:11.594951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:11.731805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:11.741179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-05e7622c-4fcf-4d3a-8ce9-4826394208de tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.160508 Aug 29 23:06:11.741908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1454/2801] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:11.946283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:11.947375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:11.954192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:11.954666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:11.955231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:11.955774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:11.956361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:11.956737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:12.086383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:12.086989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:12.090501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:12.093174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:12.093679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:12.094097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:12.094813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:12.095260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:12.095676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:12.099022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-677ec862-a107-47e8-a807-4df283ebd903 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.156939 Aug 29 23:06:12.099685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1348/2802] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:11 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:12.165839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:12.175943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:12.177351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:12.178515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-961c67e0-cd05-454c-a887-2f7ea3c9739e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096048 Aug 29 23:06:12.179097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1455/2803] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:12.762827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:12.763445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:12.769945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:12.770437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:12.770870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:12.771577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:12.772030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:12.772484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:12.918496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:12.927636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4fd11b27-2107-4754-a224-f58a2825f104 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168757 Aug 29 23:06:12.928345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1349/2804] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:13.120746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:13.121517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:13.128175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:13.128648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:13.129074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:13.129756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:13.130203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:13.130620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:13.213193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:13.213807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:13.221443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:13.222109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:13.222551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:13.223253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:13.223706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:13.224129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:13.267117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:13.275874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d4a8a146-ba5b-4df7-a179-fa52d95a6830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158879 Aug 29 23:06:13.276490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1456/2805] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:13.295351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:13.304547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:13.306016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:13.307218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f41276e6-2f67-4fc2-80b9-06bc396330cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.098513 Aug 29 23:06:13.308002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1350/2806] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:13 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:13.950843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:13.951489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:13.957954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:13.958445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:13.958944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:13.959658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:13.960115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:13.960573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:14.102414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:14.111564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6338b333-28f4-4717-83f4-c50104cd7b5a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165169 Aug 29 23:06:14.112179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1457/2807] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:14.298511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:14.299139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:14.306344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:14.306877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:14.307348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:14.309177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:14.309757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:14.310261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:14.331106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:14.331865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:14.338839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:14.339329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:14.340272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:14.341053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:14.341540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:14.341972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:14.414262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:14.424897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:14.426860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:14.428509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-33a3347d-c060-4967-a382-b6583afc5eec tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.101153 Aug 29 23:06:14.433086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1458/2808] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:14.467841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:14.476283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6bfab430-f8ce-471b-81a7-bdcf07d30f88 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.181805 Aug 29 23:06:14.476987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1351/2809] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:15.134043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:15.134668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:15.137604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:06:15.137904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 (ip 10.222.0.59) !!! Aug 29 23:06:15.145763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:15.146247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:15.146681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:15.147394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:15.147845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:15.148576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:15.303144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:15.313263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-709b5795-d8b5-49d9-b524-7515d5f668d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.183083 Aug 29 23:06:15.313928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1459/2810] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:15.453548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:15.454733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:15.458112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:06:15.458338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 (ip 10.222.0.59) !!! Aug 29 23:06:15.459996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:06:15.460216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 (ip 10.222.0.59) !!! Aug 29 23:06:15.461696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:06:15.461882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 (ip 10.222.0.59) !!! Aug 29 23:06:15.473944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:15.474425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:15.474860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:15.475578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:15.476029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:15.476483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:15.501307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:15.501907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:15.508709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:15.509257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:15.509691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:15.510879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:15.510879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:15.511293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:15.547094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:15.557044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:15.559437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:15.560702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ea4c1a63-9086-45a8-8656-6f39581d74dd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.112411 Aug 29 23:06:15.561314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1352/2811] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:15.655737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:15.664584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9495ed0e-fff6-4206-95cf-c0202ca9e593 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.169067 Aug 29 23:06:15.665178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1460/2812] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:16.337347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:16.337958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:16.345602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:16.346094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:16.346535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:16.347235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:16.347717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:16.348120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:16.507927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:16.517584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8e38164c-d8b6-43e9-8ff7-5d6111cdb28c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.184196 Aug 29 23:06:16.518196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1353/2813] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:16 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:16.584843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:16.585508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:16.593486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:16.593873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:16.594310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:16.595030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:16.595487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:16.595910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:16.682100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:16.689216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:16.690925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:16.692592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:16.694103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:16.695257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8b4f6d02-42d8-413e-b9e4-831d10680938 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.114534 Aug 29 23:06:16.695807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1461/2814] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:16 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:16.697703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:16.698200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:16.698634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:16.699889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:16.700381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:16.700812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:16.836952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:16.847018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d99566a0-22e0-4e62-9e34-313365936ab7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163574 Aug 29 23:06:16.847507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1354/2815] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:17.544058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:17.544707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:17.551062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:17.551690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:17.552163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:17.552951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:17.553409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:17.553836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:17.694554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:17.703376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4a02de66-b3e9-4f61-a072-b533cfffc846 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163171 Aug 29 23:06:17.703964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1462/2816] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:17 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:17.719002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:17.719603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:17.726549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:17.727037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:17.727472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:17.728192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:17.728649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:17.729078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:17.799210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:17.809978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:17.811677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:17.812910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-092c53bd-4884-4919-bc77-89a3fdb888fd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097892 Aug 29 23:06:17.813498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1355/2817] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:17 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:17.872890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:17.873549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:17.880289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:17.880782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:17.881226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:17.881973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:17.882502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:17.882970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:18.042319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:18.059411 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-51fe6e81-9b4f-44ce-ae97-375c7d1029db tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.190528 Aug 29 23:06:18.060486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1463/2818] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:18.725740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:18.726332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:18.735887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:18.736403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:18.736845 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:18.737554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:18.738013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:18.738437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:18.835980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:18.836796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:18.844786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:18.845284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:18.845724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:18.846634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:18.847103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:18.847533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:18.881270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:18.890519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-85928ee8-c448-4fa2-ac6f-bc2b96edf56b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169588 Aug 29 23:06:18.891110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1356/2819] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:18 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:18.923755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:18.933248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:18.938247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:18.938247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a2de47a5-0435-4f5e-b26d-fe6b6b650eb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.104980 Aug 29 23:06:18.938247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1464/2820] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:18 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:19.097236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:19.097751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:19.103805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:19.104334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:19.104770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:19.105531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:19.106042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:19.106464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:19.269810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:19.279213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fecad453-90bf-477b-9f11-ff0e56869d59 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.185969 Aug 29 23:06:19.279807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1357/2821] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:19.913269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:19.913912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:19.916726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=80 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:19.933272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:19.933272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:19.933272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:19.933272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:19.934141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:19.934141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:19.963072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:19.964237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:19.975909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:19.976808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:19.977587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:19.978848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:19.979677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:19.981112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:20.055231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:20.065971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:20.067424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:20.068636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dbcb60af-a7a6-4f2c-958d-72b3ed245a31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.113055 Aug 29 23:06:20.069203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1358/2822] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:19 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:20.070984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:20.079987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-02d9cb06-eb71-439e-a733-031baa99894c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170500 Aug 29 23:06:20.080624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1465/2823] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:19 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:20.301479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:20.302009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:20.303993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=78 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:20.309291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:20.309785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:20.310226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:20.310945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:20.311405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:20.311835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:20.458391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:20.468131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-96e61850-2211-4626-b6ac-4dfe67c12c32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170830 Aug 29 23:06:20.468761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1359/2824] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:21.092248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:21.094196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:21.099972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:21.100468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:21.100911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:21.101629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:21.102090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:21.102518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:21.103608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:21.104251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:21.112117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:21.112646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:21.113080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:21.113790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:21.114235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:21.114654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:21.190395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:21.200040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:21.201591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:21.202856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-613dad81-5304-4a8f-8d37-7f292c7c1d53 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.115438 Aug 29 23:06:21.203395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1466/2825] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:21 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:21.261520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:21.270741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-02edb3d3-1281-49ab-aa23-38eb379c5f09 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170999 Aug 29 23:06:21.271346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1360/2826] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:21 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:21.491514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:21.492060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:21.499595 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:21.500096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:21.500569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:21.501330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:21.501793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:21.502225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:21.692294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:21.702588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dcade4fe-3008-4572-92fe-d1902df6e2f3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.215225 Aug 29 23:06:21.703191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1467/2827] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:21 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:22.241549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:22.242142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:22.249687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:22.250227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:22.250715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:22.251460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:22.251953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:22.252468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:22.297986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:22.299397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:22.311503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:22.312382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:22.313126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:22.314391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:22.315217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:22.315988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:22.342510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:22.359461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:22.362129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:22.364209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2ad07c5e-4c0c-477f-9ea4-4cc3e37f60ed tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.126617 Aug 29 23:06:22.365261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1361/2828] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:22 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:22.470846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:22.483661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-92411d4d-9043-447f-8160-75cb0020e7b9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.193493 Aug 29 23:06:22.484272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1468/2829] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:22 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:22.724974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:22.725615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:22.736194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:22.736701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:22.737141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:22.737851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:22.738306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:22.738735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:22.890272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:22.899224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac6f1ef3-b623-4632-9341-dcf52d78310e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.178063 Aug 29 23:06:22.899824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1362/2830] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:23.400275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:23.401417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:23.413333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:23.414187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:23.414972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:23.416303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:23.417099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:23.418537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:23.492179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:23.502201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:23.503701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:23.504978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d05a0443-91d1-4f26-9824-124eb6d01a4e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.111863 Aug 29 23:06:23.505619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1469/2831] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:23 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:23.509964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:23.511175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:23.523456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:23.524413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:23.525225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:23.526542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:23.527929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:23.529069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:23.699782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:23.708936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c1900984-124b-42d1-b741-efbca1b31da2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.205012 Aug 29 23:06:23.709542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1363/2832] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:23 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:23.933821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:23.934519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:23.941666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:23.942161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:23.942601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:23.943312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:23.943772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:23.944227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:23.949647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:24.094436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:24.103577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2026f15f-532c-4bad-8107-23b96bb93b23 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.175462 Aug 29 23:06:24.104228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1470/2833] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:24.545590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:24.546219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:24.553081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:24.553561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:24.554004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:24.554699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:24.555149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:24.555569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:24.576820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:24.630116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:24.646979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:24.650033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:24.652361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cd0e9332-3e74-4a17-bd6f-71f5c57542d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.111102 Aug 29 23:06:24.653504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1364/2834] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:24 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:24.732572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:24.733237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:24.739554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:24.740050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:24.740549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:24.741280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:24.741734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:24.742163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:24.885591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:24.895698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ed46bd38-7dd4-4051-aa89-0ec26a52995b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168076 Aug 29 23:06:24.896332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1471/2835] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:24 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:25.143612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:25.144250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:25.152883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:25.153617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:25.154067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:25.154794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:25.155250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:25.155677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:25.303349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:25.313356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7d204ce1-e100-4899-ac30-4d31b31522a1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.174008 Aug 29 23:06:25.313943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1365/2836] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:25.693659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:25.694564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:25.704542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:25.705435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:25.706208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:25.707232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:25.707881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:25.708568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:25.778478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:25.787858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:25.789461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:25.790671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4fd5b7a7-6aca-49ec-88c9-2b2967d0b0c2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102141 Aug 29 23:06:25.791235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1472/2837] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:25 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:25.918232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:25.918977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:25.925637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:25.926120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:25.926560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:25.927256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:25.927711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:25.928127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:26.069500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:26.082888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1e1fabec-35ff-48ef-bfaf-41738f5f2337 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168270 Aug 29 23:06:26.083971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1366/2838] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:25 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:26.336186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:26.336727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:26.343035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:26.343523 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:26.343958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:26.344687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:26.345137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:26.345559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:26.495946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:26.505175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b777bdf4-29b2-4625-a16a-351ffc5bd486 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.172815 Aug 29 23:06:26.505848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1473/2839] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:26.829533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:26.830156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:26.836748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:26.837232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:26.837672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:26.838375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:26.838831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:26.839878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:26.914118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:26.924813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:26.926299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:26.927500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-db35bc25-c2a7-4f50-859f-413fe8d42ae2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102335 Aug 29 23:06:26.928344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1367/2840] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:26 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:27.111590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:27.112247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:27.119539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:27.120028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:27.121079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:27.122030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:27.122551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:27.122980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:27.269884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:27.279478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e54f6ad2-4502-4e15-9cbb-53e6c3caef00 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171826 Aug 29 23:06:27.280092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1474/2841] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:27 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:27.538178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:27.538798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:27.545869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:27.546357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:27.546790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:27.547591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:27.548097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:27.548568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:27.744890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:27.755074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0cd89b71-8d14-4cdb-aa88-aff3bbf0705a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.220825 Aug 29 23:06:27.755753 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1368/2842] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:27 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:27.958223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:27.958976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:27.969817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:27.970657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:27.971437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:27.972716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:27.973655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:27.974436 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:28.048215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:28.057544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:28.060240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:28.061443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-59c4f60a-0e18-4bce-98b4-d0038ca9b935 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.110994 Aug 29 23:06:28.062023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1475/2843] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:27 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:28.301803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:28.302466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:28.310408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:28.310994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:28.311467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:28.312223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:28.312683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:28.313107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:28.457772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:28.467522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b796ff82-c92e-4c1f-a265-d29d9ce65e33 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.169623 Aug 29 23:06:28.468171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1369/2844] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:28 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:28.779039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:28.779704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:28.786813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:28.787308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:28.787752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:28.788515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:28.789054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:28.789528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:28.945839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:28.955553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-18df4664-4a80-4113-ac64-cb46724a0ba3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.181433 Aug 29 23:06:28.956207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1476/2845] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:29.097536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:29.098042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:29.105307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:29.105795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:29.106303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:29.106945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:29.107402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:29.107827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:29.179090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:29.189484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:29.190948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:29.192122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a4648788-ab7a-4631-b190-d39da492cc71 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.098883 Aug 29 23:06:29.192724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1370/2846] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:29 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:29.495748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:29.496881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:29.507561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:29.508432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:29.509212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:29.510493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:29.511304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:29.512062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:29.663881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:29.675712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-712a6fe4-90fe-46a1-bc7c-33bfe691eb23 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.186962 Aug 29 23:06:29.676467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1477/2847] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:29 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:29.981774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:29.982885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:29.991322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:29.991804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:29.992273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:29.992977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:29.993434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:29.993849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:30.172468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:30.182323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-139cdb01-bfa1-4454-8678-472c4e6db396 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.206488 Aug 29 23:06:30.183617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1371/2848] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:30.215458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:30.216108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:30.222886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:30.223362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:30.223907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:30.224740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:30.225191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:30.225612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:30.300886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:30.311181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:30.312785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:30.314075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c80e3346-39ef-4266-8ba5-2e3f78f9e8b5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102901 Aug 29 23:06:30.314661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1478/2849] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:30 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:30.701696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:30.702198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:30.709129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:30.709618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:30.710050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:30.710747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:30.711209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:30.711843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:30.879265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:30.889075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac276839-062c-4787-b4d6-df76e8c619a0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.191921 Aug 29 23:06:30.889679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1372/2850] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:30 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:31.205916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:31.206561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:31.212864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:31.213342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:31.213788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:31.214493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:31.214951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:31.215366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:31.342148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:31.343195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:31.353541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:31.354345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:31.355556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:31.356275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:31.357108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:31.357551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:31.358284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:31.365142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fd05d4ed-3780-4eeb-844a-f22ff3207663 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163760 Aug 29 23:06:31.365756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1479/2851] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:31.454293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:31.464296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:31.465757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:31.466934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6bcd0717-45ff-4066-8d28-57b135968d81 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.132641 Aug 29 23:06:31.467509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1373/2852] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:31 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:31.911981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:31.912686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:31.920300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:31.920806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:31.921251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:31.921974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:31.922431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:31.922856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:32.092643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:32.101838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6649bcbe-fe5b-4b47-b9f9-0f8a0780f9d2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.193892 Aug 29 23:06:32.102449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1480/2853] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:31 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:32.388123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:32.388821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:32.395645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:32.396164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:32.396613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:32.397325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:32.397781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:32.398211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:32.491722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:32.492862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:32.504722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:32.505596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:32.506351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:32.507594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:32.508446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:32.509204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:32.545605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:32.554603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5a9aa030-af7e-4d5e-b55b-9d02d9966d75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170577 Aug 29 23:06:32.555199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1374/2854] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:32.603821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:32.613695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:32.615164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:32.616373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d7aefffc-9818-48c3-874f-1a957d38250b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.128573 Aug 29 23:06:32.617202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1481/2855] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:32 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:33.124443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:33.131719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:33.131719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:33.131719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:33.132085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:33.132795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:33.133248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:33.133671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:33.270211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:33.281140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d1fb17c2-a5ee-4603-b33c-07b439341b1b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161268 Aug 29 23:06:33.281740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1375/2856] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:33 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:33.577594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:33.578182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:33.585525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:33.586052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:33.586497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:33.587207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:33.587668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:33.588097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:33.648898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:33.649502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:33.656937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:33.657437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:33.657875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:33.658590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:33.659045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:33.659474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:33.733561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:33.743710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:33.745971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:33.747369 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b7795f5e-5c7d-433d-a3e7-a6b2b595dbe3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.102780 Aug 29 23:06:33.748175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1376/2857] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:33 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:33.757877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:33.768488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-08d0021d-8e7f-413d-b659-d58a309f94cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.195140 Aug 29 23:06:33.769083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1482/2858] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:34.303742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:34.304296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:34.313869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:34.314586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:34.315308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:34.316444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:34.317197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:34.317857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:34.465727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:34.475675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b8a52d3b-b073-481f-b098-42fd377d0159 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.175952 Aug 29 23:06:34.476305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1377/2859] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:34 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:34.770402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:34.771046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:34.778388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:34.778877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:34.779318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:34.780025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:34.780507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:34.780934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:34.791135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:34.792081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:34.801727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:34.802368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:34.802912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:34.803757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:34.804435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:34.804962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:34.858087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:34.874116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:34.876672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:34.878423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ac0f832f-f588-40e0-8fca-fcf66b142afe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.111816 Aug 29 23:06:34.879719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1483/2860] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:34 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:35.019304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:35.029294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3c30ecfa-2529-4632-9a6a-ce17dafaae7e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.241875 Aug 29 23:06:35.029804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1378/2861] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:35.498720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:35.499949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:35.510102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:35.511731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:35.512460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:35.513620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:35.514330 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:35.514794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:35.658034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:35.666801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cb78b965-e165-4604-9791-b45d46af6240 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.173023 Aug 29 23:06:35.667493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1484/2862] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:35 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:35.904741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:35.905720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:35.912086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:35.912603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:35.913032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:35.913728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:35.914173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:35.914591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:35.987568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:36.001102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:36.002635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:36.003859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-54718e03-5f95-4320-9a53-37b79590681e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.103710 Aug 29 23:06:36.004570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1379/2863] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:35 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:36.064067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:36.064703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:36.071954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:36.072493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:36.072969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:36.074428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:36.074892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:36.075323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:36.221838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:36.230284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-16e7f2a4-3b2c-4e03-8e29-1c4e43846d84 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170483 Aug 29 23:06:36.230850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1485/2864] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:36.692056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:36.693137 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:36.703034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:36.703911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:36.704722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:36.705999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:36.706781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:36.707534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:36.864860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:36.873526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-665e49c0-b47e-46b8-8da6-ed1ac40a6b82 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.188458 Aug 29 23:06:36.874126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1380/2865] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:36 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:37.028597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:37.029357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:37.035459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:37.035948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:37.036412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:37.037102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:37.037558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:37.037980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:37.101133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:37.104581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:37.117758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:37.119206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:37.120431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9364e794-6f18-40da-b54a-07d46f80ae64 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097268 Aug 29 23:06:37.120994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1486/2866] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:37 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:37.252090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:37.252731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:37.259599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:37.260091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:37.260566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:37.261345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:37.261724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:37.262676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:37.267355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:37.409163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:37.417738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aa403e03-4330-4f88-b7de-5403ba08cab5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.169723 Aug 29 23:06:37.418330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1381/2867] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:37.895718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:37.896391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:37.903417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:37.904001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:37.904480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:37.905233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:37.905766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:37.906195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:38.052689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:38.062462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ab436b29-653f-4c7c-b3aa-6838a19ddde4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171248 Aug 29 23:06:38.063062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1487/2868] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:37 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:38.144205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:38.144833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:38.151345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:38.151749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:38.152213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:38.153450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:38.153904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:38.154335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:38.226009 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:38.236293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:38.242762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:38.242762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bc715af0-0eda-4236-89d9-4793e4fb461d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.098910 Aug 29 23:06:38.242762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1382/2869] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:38 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:38.440956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:38.441658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:38.447984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:38.448505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:38.448942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:38.449676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:38.450134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:38.450627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:38.593399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:38.603499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-55d5ca35-0bec-40e3-9c30-7b0167afdeda tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166002 Aug 29 23:06:38.604189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1488/2870] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:39.083897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:39.084535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:39.091738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:39.092276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:39.092730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:39.093419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:39.093874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:39.094298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:39.229966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:39.238404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-955ad0d9-6de9-4b8a-872c-be8f73f942d0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158414 Aug 29 23:06:39.238987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1383/2871] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:39 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:39.261615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:39.262298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:39.269224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:39.269712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:39.270155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:39.270860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:39.271318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:39.271744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:39.335173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:39.345537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:39.347004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:39.348228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e948e8a7-39d1-4c73-a6ca-8fa80bf81505 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090555 Aug 29 23:06:39.348812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1489/2872] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:39 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:39.627253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:39.627874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:39.635706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:39.636215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:39.636733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:39.638196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:39.638694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:39.639195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:39.773236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:39.781904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b2276460-b561-4128-9dd8-a58af480ee5a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.159600 Aug 29 23:06:39.782489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1384/2873] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:40.261011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:40.261639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:40.268640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:40.269126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:40.269564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:40.270349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:40.270822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:40.271251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:40.374567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:40.375184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:40.381764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:40.382247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:40.382685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:40.383385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:40.383841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:40.384292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:40.415879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:40.425618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ea12f126-300b-40c8-b797-812c4b84f238 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168594 Aug 29 23:06:40.426219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1490/2874] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:40 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:40.453561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:40.463197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:40.464700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:40.466430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3103dc6f-e08a-422d-b3eb-21f770c6a7de tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.098526 Aug 29 23:06:40.466996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1385/2875] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:40 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:40.803296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:40.811834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:40.812100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:40.812676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:40.813122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:40.813846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:40.814308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:40.814737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:40.966153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:40.974432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b77cbfe9-4d90-4ddd-b7fe-0316b2a3a381 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.175223 Aug 29 23:06:40.974945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1491/2876] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:40 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:41.446293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:41.446907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:41.454221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:41.454710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:41.455149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:41.455897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:41.456435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:41.456857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:41.491671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:41.491671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:41.499638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:41.500162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:41.500650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:41.501746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:41.502247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:41.502678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:41.578027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:41.587790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:41.589347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:41.590576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a83ae3ed-e4cb-416f-bb56-0bfcd7f88dab tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.103957 Aug 29 23:06:41.591169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1492/2877] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:41 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:41.599441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:41.609063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9847057e-e836-48c3-80e1-508b3587082c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.166640 Aug 29 23:06:41.609763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1386/2878] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:41 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:41.996659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:41.997291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:42.003699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:42.004259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:42.004700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:42.005434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:42.005892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:42.006329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:42.154351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:42.163498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-99079b4e-00a4-466e-abe1-ccdee660fc41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170932 Aug 29 23:06:42.164093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1493/2879] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:42.629448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:42.630119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:42.634973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:42.636084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:42.637871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:42.638503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:42.639108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:42.640048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:42.640602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:42.641085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:42.648066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:42.648914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:42.649644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:42.651015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:42.651787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:42.653331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:42.708700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:42.718330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:42.719904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:42.721136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-986360aa-90fe-4e2d-9877-5e557377711e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096039 Aug 29 23:06:42.721706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1387/2880] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:42 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:42.825099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:42.835578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-174fc245-c1ee-4eff-a30a-0dd1f776ad57 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.207402 Aug 29 23:06:42.836321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1494/2881] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:42 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:43.187547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:43.188313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:43.194818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:43.195357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:43.195856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:43.196725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:43.197193 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:43.197686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:43.359022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:43.368398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-61df8bf6-df39-493f-9c0a-fbe852b1fdc3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.185983 Aug 29 23:06:43.368996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1388/2882] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:43.745467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:43.746259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:43.753947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:43.754504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:43.755035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:43.755867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:43.756375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:43.756895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:43.832015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:43.847400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:43.850369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:43.852628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-27bcdef0-2a13-4790-88bc-b4cb5df36822 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.111520 Aug 29 23:06:43.853921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1495/2883] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:43 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:43.859034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:43.859670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:43.866875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:43.867359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:43.867811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:43.868535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:43.868984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:43.869397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:44.030572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:44.039379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6d1140d5-1210-4f4b-98cc-46ca28046da9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.184284 Aug 29 23:06:44.039986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1389/2884] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:43 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:44.405111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:44.405856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:44.412349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:44.412839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:44.413273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:44.413980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:44.414426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:44.414856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:44.562147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:44.571263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0736b2c8-7aae-4a4f-9089-7ddb10faa63b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170153 Aug 29 23:06:44.571997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1496/2885] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:44.890943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:44.892012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:44.899802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:44.900330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:44.900784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:44.901492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:44.901955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:44.903072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:44.971973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:44.981468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:44.983003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:44.984219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-023f4275-10fb-4390-8725-48d5b39ef418 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097878 Aug 29 23:06:44.984801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1390/2886] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:44 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:45.063200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:45.063822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:45.070374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:45.070864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:45.071310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:45.072010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:45.072552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:45.072975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:45.219504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:45.228895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a89c10e0-12db-4010-add1-c45a739f6890 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.170116 Aug 29 23:06:45.229553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1497/2887] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:45 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:45.594620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:45.595130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:45.601396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:45.601886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:45.602319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:45.603014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:45.603465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:45.603887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:45.764058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:45.773117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-205e7dcd-090c-4a64-8fbe-b4f8b72c8187 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.183122 Aug 29 23:06:45.773725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1391/2888] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:46.007351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:46.007968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:46.015503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:46.016004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:46.016541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:46.017259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:46.017722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:46.018153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:46.088630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:46.098111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:46.099577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:46.100791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7c1acfec-6d7b-4ed2-9078-e30541ebfdcb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097580 Aug 29 23:06:46.101354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1498/2889] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:46 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:46.252273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:46.252826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:46.259787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:46.260316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:46.260758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:46.261454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:46.261956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:46.262381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:46.406125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:46.415450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-191e240f-a448-4151-abfe-c641d0fbffa9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167375 Aug 29 23:06:46.416251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1392/2890] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:46 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:46.796672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:46.797304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:46.803756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:46.804280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:46.804724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:46.805442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:46.805899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:46.806322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:46.974798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:46.984835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3c586400-58d7-494b-963e-874c386e2712 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.192381 Aug 29 23:06:46.985438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1499/2891] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:47.125432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:47.126051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:47.132623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:47.133112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:47.133548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:47.134254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:47.134723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:47.135143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:47.207905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:47.218179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:47.219630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:47.220829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1c4f6a7b-a598-432d-9198-b79015580486 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.100347 Aug 29 23:06:47.221392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1393/2892] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:47 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:47.443483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:47.444788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:47.458153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:47.458753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:47.459554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:47.460846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:47.461791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:47.462604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:47.618041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:47.627146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3f087aef-8426-41d0-b15d-2b5e6c12b6c4 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.191394 Aug 29 23:06:47.627743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1500/2893] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:47 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:48.009475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:48.010101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:48.018843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:48.019342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:48.019785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:48.020537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:48.020998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:48.021425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:48.163231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:48.173706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4546eac3-4dc2-45d0-aa14-035d0aeb0fb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.168070 Aug 29 23:06:48.174209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1394/2894] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:48.244920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:48.245529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:48.252645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:48.253137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:48.253627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:48.254351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:48.254807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:48.255231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:48.326422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:48.335585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:48.337093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:48.338268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-637e1b00-6496-4727-ab99-6d1943208098 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097536 Aug 29 23:06:48.338901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1501/2895] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:48 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:48.648977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:48.649716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:48.656963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:48.657445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:48.657875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:48.658570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:48.659022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:48.659437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:48.807601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:48.816805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2fa358cc-582d-4bd1-8920-43968de99b72 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171771 Aug 29 23:06:48.817399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1395/2896] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:48 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:49.197272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:49.197914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:49.205706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:49.206197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:49.206636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:49.207345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:49.207801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:49.208257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:49.361660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:49.362281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:49.363409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:49.369456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:49.369949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:49.370389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:49.371259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:49.371722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:49.372175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:49.372740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-442a7fe2-2a4d-4f21-a961-be5de739bdb8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.179331 Aug 29 23:06:49.373335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1502/2897] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:49.439893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:49.449955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:49.451838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:49.453076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9cc057d8-2895-454a-9c0b-66ca261dbfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095371 Aug 29 23:06:49.453663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1396/2898] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:49 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:49.839175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:49.840499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:49.846758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:49.847251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:49.847693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:49.848439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:49.848896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:49.849328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:49.868876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:49.992984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:50.002552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a5b8e764-7c77-45e0-b74f-ec239a3dbfcb tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.167368 Aug 29 23:06:50.003230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1503/2899] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:49 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:50.394625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:50.395345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:50.397758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=76 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:50.402851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:50.403346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:50.403801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:50.404648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:50.405103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:50.405528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:50.482956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:50.483562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:50.485996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=78 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:50.490817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:50.491190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:50.491623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:50.492353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:50.492810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:50.499403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:50.544921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:50.548465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:06:50.553463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d20006ff-9074-4a4c-ba4a-8f30ae372c2b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162974 Aug 29 23:06:50.554048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1397/2900] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:50.564299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:50.573082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:50.575004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:50.576189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-756979c4-fbed-497a-85bf-be041edd6a35 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097171 Aug 29 23:06:50.576748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1504/2901] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:50 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:51.025699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:51.026317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:51.033196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:51.033706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:51.034126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:51.034826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:51.035284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:51.035706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:51.168255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:51.176883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c4544bcb-cfff-4ba8-82ff-9c59cfbcd707 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155024 Aug 29 23:06:51.177386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1398/2902] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:51 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:51.576184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:51.576720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:51.583216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:51.583693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:51.584124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:51.584833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:51.585279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:51.585701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:51.598798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:51.599399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:51.606454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:51.607033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:51.607476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:51.608197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:51.608651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:51.609073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:51.677875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:51.687125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:51.688632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:51.689794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7fb130f9-38ef-4118-908a-0e25cffb2900 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095057 Aug 29 23:06:51.690368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1399/2903] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:51 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:51.722567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:51.731605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-418c74a9-48b8-471b-bb83-73f4bbe77472 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.159338 Aug 29 23:06:51.732187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1505/2904] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:52.199953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:52.200649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:52.206758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:52.207265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:52.207732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:52.208540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:52.209008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:52.209428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:52.341955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:52.350485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-651c3700-4d96-410c-a155-f3b946bd6f4c tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155429 Aug 29 23:06:52.351047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1400/2905] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:52 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:52.712948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:52.713544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:52.720305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:52.720796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:52.721237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:52.721943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:52.722406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:52.722839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:52.758953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:52.759653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:52.767288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:52.767772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:52.768239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:52.768943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:52.769428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:52.769848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:52.788617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:52.797618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:52.799085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:52.800257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-803d527c-d539-452b-bb3b-105287e07832 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091358 Aug 29 23:06:52.800821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1506/2906] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:52 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:52.903534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:52.911971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c2333573-a574-4fb9-9af8-77ea72e95a63 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.156829 Aug 29 23:06:52.912572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1401/2907] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:53.373021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:53.374323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:53.380234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:53.380713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:53.381150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:53.381847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:53.382299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:53.382813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:53.522178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:53.531220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e6ac0586-5c2b-4ab1-9126-315178446c0d tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162681 Aug 29 23:06:53.531819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1507/2908] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:53 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:53.825602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:53.826502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:53.833983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:53.834477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:53.834909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:53.835615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:53.836068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:53.836535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:53.916984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:53.927895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:53.929526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:53.930702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cef47fda-6ce1-433b-9a94-e79352238196 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.110245 Aug 29 23:06:53.936717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1402/2909] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:53 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:06:53.936913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:53.936913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:53.943085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:53.943577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:53.944020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:53.944752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:53.945208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:53.945636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:54.079575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:54.089195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-438df230-5c54-4040-86c7-09035e2ff5cb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158214 Aug 29 23:06:54.089773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1508/2910] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:53 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:54.553482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:54.554093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:54.560969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:54.561439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:54.561868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:54.562568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:54.563012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:54.563427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:54.702135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:54.712836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d574e95f-dd83-4a03-bfdf-df4372a423d5 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163269 Aug 29 23:06:54.713445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1403/2911] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:54 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:54.953875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:54.954457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:54.960924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:54.961417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:54.961848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:54.962536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:54.962985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:54.963401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:55.030327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:55.039186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:55.040663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:55.041822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-07770f3d-0a5e-4e8c-b4cd-8d16cef90456 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092634 Aug 29 23:06:55.042386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1509/2912] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:54 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:55.111496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:55.112105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:55.118855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:55.119333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:55.119766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:55.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:55.120937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:55.121358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:55.255978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:55.264793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ae4b9986-57dd-43f6-9215-9caa40624d48 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157215 Aug 29 23:06:55.265372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1404/2913] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:55.733843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:55.734463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:55.741194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:55.741730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:55.742177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:55.742879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:55.743336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:55.743770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:55.892736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:55.901371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6c000a0b-5de8-4d6c-b539-16f2796acc9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.171563 Aug 29 23:06:55.901956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1510/2914] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:55 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:56.067802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:56.068353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:56.074483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:56.075508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:56.076612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:56.076822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:56.077231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:56.077648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:56.285756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:56.286377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:56.292537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:56.293033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:56.293481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:56.294277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:56.294693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:56.295131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:56.296440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:56.305841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:56.307307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:56.308755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bb04eb3c-c1d0-4b33-aed5-b4a7fd16feb5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.245308 Aug 29 23:06:56.309988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1405/2915] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:56 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:56.428605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:56.437736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-70cbf3d9-2f8f-4cae-890e-5fcd2b5c1785 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155900 Aug 29 23:06:56.438313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1511/2916] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:06:56.923583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:56.924222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:56.930428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:56.930915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:56.931350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:56.932038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:56.932770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:56.933227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:57.065343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:57.073791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-99f490e2-1ed8-4ebf-aee1-eb9fc7a9cb81 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.154741 Aug 29 23:06:57.074348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1406/2917] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:56 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:57.332496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:57.333069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:57.339616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:57.340094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:57.341218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:57.342073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:57.342532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:57.342957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:57.406273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:57.415215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:57.416725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:57.417869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c2a228eb-901c-4d69-bb01-5146e7e439b7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.089568 Aug 29 23:06:57.418437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1512/2918] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:57 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:57.460286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:57.461099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:57.468386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:57.476284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:57.476284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:57.476284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:57.476284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:57.476710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:57.602224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:57.611171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c30bcc5e-fe0a-4f95-9cce-40165ab91d95 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.154813 Aug 29 23:06:57.611747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1407/2919] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:58.095865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:58.096516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:58.102939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:58.103433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:58.103876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:58.104615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:58.105163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:58.105947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:58.245782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:58.254361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-deb3e9fc-071d-44f6-9647-1b560e69c4a8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.162702 Aug 29 23:06:58.254931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1513/2920] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:58 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:58.440699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:58.441217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:58.447463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:58.447939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:58.448399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:58.449093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:58.450172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:58.450172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:58.515950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:58.524762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:58.526247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:58.527386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5e58a4a3-c396-4161-b4a2-b7b69362ef69 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090745 Aug 29 23:06:58.528480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1408/2921] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:58 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:58.633026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:58.633666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:58.640525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:58.641015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:58.641454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:58.642164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:58.642621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:58.643188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:58.782806 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:58.791704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3c2e5799-657a-4b69-b7a4-f36f730c635a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162489 Aug 29 23:06:58.792327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1514/2922] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:59.276577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:59.276971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:59.283588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:59.284066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:59.284567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:59.285256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:59.285699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:59.286116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:59.423396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:59.433763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1e22088b-c9dd-4187-af25-d3faf6f2bc4b tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.161542 Aug 29 23:06:59.434464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1409/2923] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:59 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:06:59.551152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:59.551651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:59.558290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:59.558770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:59.559380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:59.559965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:59.560450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:59.560874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:59.626030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:59.635770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:59.637823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:59.639243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cb06618b-de17-4842-995d-c69cad8ed83f tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.092137 Aug 29 23:06:59.639809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1515/2924] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:06:59 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:06:59.814188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:06:59.814778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:06:59.821452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:59.821930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:59.822362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:59.823055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:06:59.823508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:06:59.823930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:06:59.958621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:06:59.967642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-928b4a03-ef2c-499b-92de-0dbcb5710443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157584 Aug 29 23:06:59.968251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1410/2925] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:06:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:00.455761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:00.456439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:00.463124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:00.463611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:00.464051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:00.464771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:00.465237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:00.465764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:00.600689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:00.609698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f5026684-efd6-4ee3-8ec5-ae39af28961e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.157899 Aug 29 23:07:00.610274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1516/2926] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:00 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:00.663203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:00.663805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:00.670623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:00.671221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:00.671547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:00.672277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:00.672733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:00.673343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:00.741890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:00.751802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:00.753362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:00.754591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c0bbbfdd-558e-43f4-888b-e3551cb37c5c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095329 Aug 29 23:07:00.755151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1411/2927] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:00 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:00.988790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:00.989460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:00.995649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:00.996170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:00.996644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:00.997345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:00.997800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:00.998236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:01.128962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:01.137720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fd097674-a0ef-4f75-9e6b-cd2d2e3d0609 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.152319 Aug 29 23:07:01.138304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1517/2928] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:01.631940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:01.632630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:01.641206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:01.642071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:01.642790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:01.643788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:01.644483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:01.645096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:01.778403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:01.779022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:01.786228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:01.786719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:01.787380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:01.788614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:01.789464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:01.790189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:01.807794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:01.813033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d198fc3f-bf4b-44a6-b377-b81b9323b27a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.184886 Aug 29 23:07:01.813744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1412/2929] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:01 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:01.865363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:01.876290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:01.877497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:01.878762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-de87e5e9-4e90-470f-8e07-fb988ce5bd4d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.105094 Aug 29 23:07:01.879328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1518/2930] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:01 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:02.160395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:02.161008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:02.170164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:02.170738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:02.171087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:02.171782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:02.172261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:02.172690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:02.332443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:02.342324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e579274b-9e4d-45c3-ad26-f3ea6e91781b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.185892 Aug 29 23:07:02.342910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1413/2931] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:02.834885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:02.835746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:02.842677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:02.843171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:02.843615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:02.844418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:02.844914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:02.845352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:02.907197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:02.907825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:02.914618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:02.915099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:02.915532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:02.916299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:02.918208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:02.918208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:02.938254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:02.985746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:02.986479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:02.994753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3732e5f2-528e-4bc3-b427-7ed892bf25cf tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163595 Aug 29 23:07:02.995357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1519/2932] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:02 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:02.996089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:02.997876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:02.999195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b31cacf7-c535-41a4-a588-b0c0b8e6d7ba tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.097169 Aug 29 23:07:02.999956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1414/2933] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:02 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:07:03.365396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:03.366010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:03.372313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:03.372632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:03.373072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:03.373765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:03.374221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:03.374648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:03.378723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:03.505989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:03.515128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-379085c1-ca14-4b23-b0d2-ad072ae325f5 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.153663 Aug 29 23:07:03.515717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1520/2934] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:04.017410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:04.018018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:04.022339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:04.022953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:04.024932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:04.026051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:04.026051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:04.026536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:04.026986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:04.027410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:04.030246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:04.030746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:04.031186 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:04.033319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:04.033319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:04.033319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:04.106512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:04.123338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:04.126231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:04.128193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c7881757-0913-4c29-9197-830ecf37fb91 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.109773 Aug 29 23:07:04.129614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1521/2935] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:04 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:07:04.162911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:04.171773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e11e6012-a86f-4e06-9e7d-b4602c319811 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158367 Aug 29 23:07:04.172283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1415/2936] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:04 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:04.537142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:04.537763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:04.544874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:04.545365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:04.545804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:04.546509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:04.546963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:04.547387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:04.685503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:04.694593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6de3d218-f19f-4f55-bad6-8684bd56721e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.161288 Aug 29 23:07:04.695178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1522/2937] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:05.152060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:05.153418 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:05.160021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:05.160539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:05.160978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:05.161668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:05.162121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:05.162548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:05.193700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:05.194246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:05.201480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:05.202048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:05.202399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:05.203090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:05.203545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:05.204280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:05.226847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:05.236130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:05.237627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:05.238779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fa73e2df-5b8d-4ba1-8c11-5edd762053c3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.090659 Aug 29 23:07:05.239358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1416/2938] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:05 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:05.344321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:05.352853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8b700299-7317-4bc6-8a0c-88aba537d215 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.163060 Aug 29 23:07:05.353430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1523/2939] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:05 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:05.716367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:05.716893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:05.723120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:05.723593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:05.724030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:05.724746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:05.725190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:05.725605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:05.873497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:05.884723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d2c78910-591d-4d31-9c21-80daa5becbb3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.172263 Aug 29 23:07:05.885297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1417/2940] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:05 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:06.275142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:06.315503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:06.315503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:06.315503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:06.315503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:06.315961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:06.315961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:06.315961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:06.354699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:06.364242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:06.365685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:06.366829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6908f396-1399-43f3-915c-a986d31ab9c0 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.095992 Aug 29 23:07:06.367388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1524/2941] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:06 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:06.373543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:06.374151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:06.380840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:06.381322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:06.381756 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:06.382450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:06.382929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:06.383350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:06.529301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:06.537641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6e8d5339-9af6-485e-b7dd-53f5295750f8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.168281 Aug 29 23:07:06.538213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1418/2942] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:06 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:06.906356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:06.906970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:06.913466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:06.913953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:06.914390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:06.915103 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:06.915558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:06.916091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:07.060507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:07.069058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7e3fafbe-def1-456a-825b-072073526b01 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166620 Aug 29 23:07:07.069668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1525/2943] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:07.390469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:07.391086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:07.397991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:07.401584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:07.401584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:07.401584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:07.401584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:07.402173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:07.472196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:07.482231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:07.483688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:07.484989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cceb41b9-e42e-4c8c-b3aa-aa3031aadcea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.098933 Aug 29 23:07:07.485540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1419/2944] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:07 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:07.559341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:07.559997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:07.567068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:07.567562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:07.568009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:07.568778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:07.569245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:07.569680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:07.720860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:07.731487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9058a38f-e7e4-49c5-bccb-32293bd38b19 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.175740 Aug 29 23:07:07.732097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1526/2945] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:07 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:08.091517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:08.092243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:08.099081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:08.099563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:08.099994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:08.100730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:08.101234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:08.101655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:08.256241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:08.265896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c722c405-ea95-43e5-afac-b4efee455cd8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.179128 Aug 29 23:07:08.266507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1420/2946] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:08.507954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:08.508596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:08.515093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:08.515579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:08.516021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:08.516747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:08.517220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:08.517636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:08.586088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:08.596130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:08.597621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:08.598779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ff54383d-2936-4553-8805-37dc55b53b0d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094867 Aug 29 23:07:08.599364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1527/2947] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:08 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:08.753705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:08.754291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:08.760849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:08.761331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:08.761794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:08.762486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:08.762931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:08.763843 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:08.896504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:08.904871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e72e12a3-245a-4ec5-b525-ecea3bf93d3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.155257 Aug 29 23:07:08.905447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1421/2948] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:08 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:09.291660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:09.292833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:09.301847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:09.302345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:09.302788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:09.303501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:09.303965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:09.304433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:09.458122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:09.466575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-06a83636-63c9-4114-b68b-37d941892454 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.182274 Aug 29 23:07:09.467272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1528/2949] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:09 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:09.622188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:09.623379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:09.629588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:09.630077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:09.630518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:09.631214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:09.631670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:09.632095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:09.695223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:09.704168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:09.705630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:09.706769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-41a17557-20cf-4dfe-a5cf-b87fb8165d22 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.088599 Aug 29 23:07:09.707315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1422/2950] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:09 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:09.926506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:09.927123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:09.934119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:09.934607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:09.935536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:09.936642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:09.937108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:09.937531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:10.080053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:10.088571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ef9e2f48-55ed-44a2-bbf4-f6d206ef7ef3 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.165985 Aug 29 23:07:10.089262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1529/2951] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:09 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:10.487707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:10.488423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:10.494933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:10.495419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:10.495858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:10.496589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:10.497049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:10.497478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:10.639890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:10.648421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-29c3be56-7e88-487b-9a40-ca12956c8f5c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.164543 Aug 29 23:07:10.648995 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1423/2952] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:10.733454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:10.733993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:10.740241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:10.740729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:10.741192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:10.741894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:10.742346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:10.742771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:10.812668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:10.822060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:10.823516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:10.824739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-692c60dc-a7ed-421c-a654-a0f7ff4f3a1e tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.096313 Aug 29 23:07:10.825265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1530/2953] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:10 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:11.111392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:11.111899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:11.118858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:11.119355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:11.119799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:11.120572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:11.121038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:11.121469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:11.282420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:11.291042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ba793bb1-57f1-44f2-a175-f6cbd599a4ce tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.184535 Aug 29 23:07:11.291663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1424/2954] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:11 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:11.672000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:11.672708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:11.679320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:11.679809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:11.680288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:11.680985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:11.681431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:11.681851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:11.829166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:11.837578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-23031a97-bb2c-48a0-8e1a-1de649a6f443 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170792 Aug 29 23:07:11.838161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1531/2955] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:11 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:11.848484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:11.849737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:11.857075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:11.857560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:11.857996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:11.858695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:11.859182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:11.859606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:11.926154 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:11.935644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:11.937097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:11.938227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d5581131-18b9-4d40-8244-fa94c6005d16 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.093842 Aug 29 23:07:11.938778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1425/2956] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:11 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:07:12.313674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:12.314201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:12.320282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:12.320771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:12.321261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:12.321962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:12.322419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:12.322847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:12.458129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:12.467944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eb81208b-c582-48ba-8739-7ee6dea1fbe2 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.158751 Aug 29 23:07:12.468594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1532/2957] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:12 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:12.860038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:12.860683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:12.867559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:12.868042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:12.868506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:12.869198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:12.869641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:12.870450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:12.963522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:12.968539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:12.974530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:12.975079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:12.975417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:12.976189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:12.976648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:12.977067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:13.018406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:13.028968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0f1ded24-d852-428e-bed5-7d1e3c1c1d96 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.173840 Aug 29 23:07:13.032196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1426/2958] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:13.062032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:13.070840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:13.072353 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:13.073488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9809ab09-8027-4714-8d0d-4a0ab11587bb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.115123 Aug 29 23:07:13.074042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1533/2959] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:12 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:13.488870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:13.489466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:13.495326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:13.495796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:13.496285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:13.496956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:13.497404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:13.497816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:13.629299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:13.637439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0bf3cb22-5be9-45e3-839e-805adac35c9a tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.152324 Aug 29 23:07:13.638016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1427/2960] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:13 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:14.052871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:14.053493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:14.060451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:14.060942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:14.062065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:14.062774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:14.063234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:14.063668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:14.097504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:14.098102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:14.104682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:14.105158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:14.105584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:14.106271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:14.106714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:14.107132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:14.174555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:14.184078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:14.185679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:14.186972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1583768c-efb7-4b07-bedd-d12345798204 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.094219 Aug 29 23:07:14.187823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1428/2961] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:14 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:07:14.200528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:14.209023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8fc5168b-85aa-47eb-b7e1-c9832c7cf1c0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160006 Aug 29 23:07:14.209597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1534/2962] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:14.660189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:14.660834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:14.667466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:14.668042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:14.668612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:14.669482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:14.670027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:14.670525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:14.804854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:14.814174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bc67e7e2-572d-4360-a713-8fe4b467f068 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.157844 Aug 29 23:07:14.814768 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1429/2963] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:14 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:15.209357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:15.209961 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:15.216419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:15.216899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:15.217397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:15.218176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:15.218628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:15.219051 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:15.230611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:15.231350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:15.238458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:15.238942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:15.239380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:15.240078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:15.240584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:15.240984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:15.284522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:15.293775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:15.295222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:15.296926 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-29f40cb1-af89-44f7-a0f5-2db0aaf3f2a3 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 200 len: 1445 microversion: 2.20 time: 0.091502 Aug 29 23:07:15.298369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1535/2964] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:15 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:15.320473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8f20c236-5b2f-4918-96e0-23d6907e186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '.version_select at 0x7febd89aad30>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:15.378946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:15.387032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0f9b0ce2-5db7-4d77-abdd-f6434c03ba9b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160293 Aug 29 23:07:15.387591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1430/2965] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:15.425299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8f20c236-5b2f-4918-96e0-23d6907e186b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832506780" status: 204 len: 0 microversion: 2.20 time: 0.108501 Aug 29 23:07:15.425990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1536/2966] 10.222.0.59 () {60 vars in 1262 bytes} [Mon Aug 29 23:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832506780 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 23:07:15.836818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:15.837436 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 0a903cf9-0a2d-4391-ad67-ae87403930d7] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:15.843697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:15.844202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:15.844642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:15.845329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:15.845799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:15.846204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:15.850244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:15.977956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:15.987147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-98561c41-2304-4a68-a274-10f1c480b7b0 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7" status: 200 len: 1736 microversion: 2.1 time: 0.154760 Aug 29 23:07:15.988062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1431/2967] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:15 2022] GET /compute/v2.1/servers/0a903cf9-0a2d-4391-ad67-ae87403930d7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:16.008542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a0d81195-a9ec-4489-84a1-3809f2f4b4cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '.version_select at 0x7febd4fdeb80>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:16.136652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a0d81195-a9ec-4489-84a1-3809f2f4b4cd tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-850289673" status: 202 len: 0 microversion: 2.1 time: 0.131965 Aug 29 23:07:16.137247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1537/2968] 10.222.0.59 () {58 vars in 1218 bytes} [Mon Aug 29 23:07:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-850289673 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:07:16.383566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ddb8746c-316b-4534-8ad1-d9e424f8cdd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Action: 'create', calling method: .version_select at 0x7febd89d4280>, body: {"keypair": {"name": "tempest-keypair-604934531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk0ZEjFzU9ulOlwr5xm3i1j7iS+STmQvylTuNGz1n/MRsYjehE9ACKDCQgXGKIekBnb5xXqiyiPkA7a7gyse5XP533Rj42Zebod10saE6OAGFgjQdggURbFzZqmGk5BFg=="}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:07:16.402634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-ddb8746c-316b-4534-8ad1-d9e424f8cdd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Getting quotas for project d45f8dd557e14a6483ebe7e39d902641. Resources: {'key_pairs'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:07:16.407112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-ddb8746c-316b-4534-8ad1-d9e424f8cdd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Getting quotas for user 42a287a54c4040ac828ee221a3f2e8c7 and project d45f8dd557e14a6483ebe7e39d902641. Resources: {'key_pairs'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:07:16.408422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:16.409615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:16.418874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:16.419524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:16.420084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:16.421903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:16.422475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:16.423158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:16.531396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ddb8746c-316b-4534-8ad1-d9e424f8cdd8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.151947 Aug 29 23:07:16.534987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1432/2969] 10.222.0.59 () {62 vars in 1200 bytes} [Mon Aug 29 23:07:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 23:07:16.810493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:16.815733 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:16.824587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9a23796e-80d5-47b1-8e20-af474f84c8da tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.419514 Aug 29 23:07:16.825966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1538/2970] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:17.676238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:17.676238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:17.689944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:17.690763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:17.691209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:17.691925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:17.692407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:17.692838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:17.765655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:07:17.847495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:17.848250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:17.855365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:17.855935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:17.856692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:17.857460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:17.858690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:17.859328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:18.052305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:18.064215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-07ca974c-d3cb-4e7c-ac7a-dadc738c10b8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.219100 Aug 29 23:07:18.076710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1539/2971] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:18.149376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-60ecf5c2-9c9e-4f92-be7a-0fab78784721 req-23d79952-830e-4895-a93e-8143851b9fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a903cf9-0a2d-4391-ad67-ae87403930d7", "tag": "7f847326-2f84-445f-8fd3-98855eb599bf"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:07:18.174777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-60ecf5c2-9c9e-4f92-be7a-0fab78784721 req-23d79952-830e-4895-a93e-8143851b9fff service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:18.175798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-60ecf5c2-9c9e-4f92-be7a-0fab78784721 req-23d79952-830e-4895-a93e-8143851b9fff service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:18.176611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-60ecf5c2-9c9e-4f92-be7a-0fab78784721 req-23d79952-830e-4895-a93e-8143851b9fff service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:18.192564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-60ecf5c2-9c9e-4f92-be7a-0fab78784721 req-23d79952-830e-4895-a93e-8143851b9fff service nova] Creating event network-changed:7f847326-2f84-445f-8fd3-98855eb599bf for instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 on hv-cinder-85426 Aug 29 23:07:18.200093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-60ecf5c2-9c9e-4f92-be7a-0fab78784721 req-23d79952-830e-4895-a93e-8143851b9fff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121159 Aug 29 23:07:18.201106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1540/2972] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:07:18.207955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a7f0d6f1-069d-43ee-9b5f-1bd87d3fb639 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] Calling method '.version_select at 0x7febd4fdeaf0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:18.215494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82e47ab7-b2cb-4560-a9cf-31368282bfad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 204 len: 0 microversion: 2.1 time: 0.548558 Aug 29 23:07:18.218781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1433/2973] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:07:17 2022] DELETE /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:07:18.227777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:18.228746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:18.242062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:18.242560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:18.243273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:18.243732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:18.244292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:18.244725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:18.359767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a7f0d6f1-069d-43ee-9b5f-1bd87d3fb639 tempest-TestVolumeBootPattern-783858011 tempest-TestVolumeBootPattern-783858011-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1311812733" status: 202 len: 0 microversion: 2.1 time: 0.156045 Aug 29 23:07:18.360761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1541/2974] 10.222.0.59 () {58 vars in 1263 bytes} [Mon Aug 29 23:07:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1311812733 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:07:18.524086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:18.538844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6f41dbc6-2472-4b65-ad05-632c080c871f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.312275 Aug 29 23:07:18.540101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1434/2975] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:18 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:19.085114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:19.086030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:19.099578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:19.100513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:19.101058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:19.101890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:19.102453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:19.103224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:19.491650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:19.501675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c62b7237-24a3-47fe-9890-945a2e77d721 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.421201 Aug 29 23:07:19.502402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1542/2976] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:19.561656 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:19.562277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:19.570460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:19.576358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:19.576358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:19.576358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:19.576358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:19.577416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:19.715358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:19.725354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2987c050-9590-4dba-b52f-577e165ca905 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.168564 Aug 29 23:07:19.725938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1435/2977] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:19 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:20.523181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:20.524658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:20.527492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=3 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:20.534940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:20.535447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:20.535889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:20.536747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:20.537205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:20.537852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:20.747936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:20.749796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:20.752008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:20.757435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:20.758024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:20.758754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:20.759543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:20.760069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:20.760585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:20.910181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:20.919208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-92571ec6-db40-4b89-9ead-060bc96ccf8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.175190 Aug 29 23:07:20.932212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1436/2978] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:20 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:21.074722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1654652809", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9551621c-c4f2-4297-ad29-3abc9d72be15"}], "security_groups": [{"name": "tempest-securitygroup--793855657"}], "key_name": "tempest-keypair-604934531", "user_data": "}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:07:21.099453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:21.109619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-08e281ce-858f-4dc7-a3c9-75a1fd0b4b58 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.590249 Aug 29 23:07:21.110431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1543/2979] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:21.190089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.network.neutron [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] validate_networks() for [('9551621c-c4f2-4297-ad29-3abc9d72be15', None, None, None, None, None)] {{(pid=128151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:07:21.792457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Flavor limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:07:21.793071 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Image limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:07:21.793620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Flavor pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:07:21.794100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Image pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:07:21.794585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:07:21.807249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:21.807927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:21.809772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:21.809772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:21.810174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:21.810467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:21.832005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Getting quotas for project d45f8dd557e14a6483ebe7e39d902641. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:07:21.838892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Getting quotas for user 42a287a54c4040ac828ee221a3f2e8c7 and project d45f8dd557e14a6483ebe7e39d902641. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:07:21.853393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Going to run 1 instances... {{(pid=128151) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:07:21.856001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:07:21.942194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:21.945275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:21.949700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:21.950307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:21.950933 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:21.952759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:21.953417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:21.953841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:21.988304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ce6af3a1-7ee0-4f53-b38d-2149cc4415eb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.918830 Aug 29 23:07:21.989640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1437/2980] 10.222.0.59 () {62 vars in 1188 bytes} [Mon Aug 29 23:07:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 23:07:22.002294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8b92032b-18fc-41b6-8ee7-15787ad747f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:22.003222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8b92032b-18fc-41b6-8ee7-15787ad747f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:22.121858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8b92032b-18fc-41b6-8ee7-15787ad747f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:22.133985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8b92032b-18fc-41b6-8ee7-15787ad747f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:22.139130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8b92032b-18fc-41b6-8ee7-15787ad747f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:22.139130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8b92032b-18fc-41b6-8ee7-15787ad747f7 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1281 microversion: 2.20 time: 0.140640 Aug 29 23:07:22.139408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:22.139534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1438/2981] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:21 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:22.144816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:22.146089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:22.146680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9c30304b-47b3-4dd5-81f4-3d1e33c8a207 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.208162 Aug 29 23:07:22.147810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1544/2982] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:21 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:22.158007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:22.158854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:22.159463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:22.160211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:22.160667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:22.161081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:22.345270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:22.355291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d403b9a9-70c4-4640-9f8b-411e6eb7ff52 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.216462 Aug 29 23:07:22.356277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1439/2983] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:23.162331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cd00ed95-d635-4ae3-80d2-bb5aa517ee42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:23.163345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cd00ed95-d635-4ae3-80d2-bb5aa517ee42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:23.169681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:23.171165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:23.179121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:23.179862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:23.180413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:23.181131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:23.181576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:23.182251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:23.247013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cd00ed95-d635-4ae3-80d2-bb5aa517ee42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:23.255732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cd00ed95-d635-4ae3-80d2-bb5aa517ee42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:23.257311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cd00ed95-d635-4ae3-80d2-bb5aa517ee42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:23.258655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cd00ed95-d635-4ae3-80d2-bb5aa517ee42 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1281 microversion: 2.20 time: 0.102446 Aug 29 23:07:23.259425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1545/2984] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:23 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1281 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:23.381304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:23.382193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:23.389754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:23.390252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:23.390686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:23.391623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:23.392285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:23.392879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:23.495186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:23.505029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-316b08e6-aee8-4f22-a0cb-3c1cd47798e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.340429 Aug 29 23:07:23.506452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1440/2985] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:23 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:23.551922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:23.560690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8dd5e5f8-c2b8-40d3-9ecd-9c6528f1cf3d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.183450 Aug 29 23:07:23.561280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1546/2986] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:24.282904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c09e9c8b-82bc-4859-a3c4-56041ef18aeb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:24.283663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c09e9c8b-82bc-4859-a3c4-56041ef18aeb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:24.354579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c09e9c8b-82bc-4859-a3c4-56041ef18aeb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:24.367697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c09e9c8b-82bc-4859-a3c4-56041ef18aeb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:24.375786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c09e9c8b-82bc-4859-a3c4-56041ef18aeb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:24.375786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c09e9c8b-82bc-4859-a3c4-56041ef18aeb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1281 microversion: 2.20 time: 0.096855 Aug 29 23:07:24.376285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1441/2987] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:24 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:24.528015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:24.528588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:24.535327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:24.535820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:24.536300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:24.537178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:24.537635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:24.538439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:24.584116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:24.584926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:24.601086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:24.601086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:24.601518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:24.602012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:24.602649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:24.603326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:24.745252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:24.754779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-989cf9c4-044e-4c55-9550-cdbd0dc69f8c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.175683 Aug 29 23:07:24.755417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1442/2988] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:24.758423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:24.768452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f300b2ef-a51f-4838-8d2a-5a7dc980e2b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.244894 Aug 29 23:07:24.769708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1547/2989] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:24 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:25.398325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8f5d7150-5862-4782-bd19-8202d9cfb287 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:25.398927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8f5d7150-5862-4782-bd19-8202d9cfb287 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:25.458590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f5d7150-5862-4782-bd19-8202d9cfb287 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:25.466597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f5d7150-5862-4782-bd19-8202d9cfb287 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:25.468293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8f5d7150-5862-4782-bd19-8202d9cfb287 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:25.485060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8f5d7150-5862-4782-bd19-8202d9cfb287 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1281 microversion: 2.20 time: 0.075248 Aug 29 23:07:25.485060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1443/2990] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:25 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:25.777983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:25.778653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:25.791025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:25.792253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:25.793053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:25.793967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:25.794593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:25.795368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:25.797206 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:25.798216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:25.807045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:25.808421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:25.809241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:25.810148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:25.811018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:25.812517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:25.959396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:25.968498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7203f742-ad32-40d3-81cb-a60505d9a6c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.178056 Aug 29 23:07:25.978267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1444/2991] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:25 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:26.037684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:26.050167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-87e76863-5fc1-4f15-b459-fdc9bb9ea39f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.277076 Aug 29 23:07:26.050778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1548/2992] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:26.493340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:26.493948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:26.501262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:26.506264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:26.506930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:26.507859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:26.508663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:26.509100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:26.611469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:26.620828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:26.622674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:26.625619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-506f5cf8-1f21-4dc4-b581-e6d919d8b330 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1285 microversion: 2.20 time: 0.136584 Aug 29 23:07:26.640399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1445/2993] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:26 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:26.990735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:26.991490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:26.998310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:26.998847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:26.999592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:27.000584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:27.001140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:27.001660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:27.072127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:27.077699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:27.088826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:27.089527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:27.090431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:27.091491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:27.092233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:27.093387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:27.157597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:27.166716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-17173331-6011-471a-b729-3c61c52f902a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.180109 Aug 29 23:07:27.167310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1549/2994] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:26 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:27.328948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:27.340375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-af539e6d-c8f8-446d-8ceb-239da5d15ea8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.271765 Aug 29 23:07:27.341208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1446/2995] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:27 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:27.649348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:27.650424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:27.656911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:27.657548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:27.658131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:27.659005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:27.659745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:27.660434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:27.726072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:27.736282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:27.737825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:27.738964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7d1f6922-ad6b-499f-87da-acb93d1dc2d1 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1285 microversion: 2.20 time: 0.094180 Aug 29 23:07:27.739515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1550/2996] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:27 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:28.191941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:28.193814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:28.202876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:28.203725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:28.204319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:28.206067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:28.206794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:28.207439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:28.364680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:28.365313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:28.372395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:28.378184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:28.378184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:28.378184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:28.378184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:28.379027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:28.379120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:28.387800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-58a7cb57-94e9-48fb-b04e-8e5c784573b1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.201612 Aug 29 23:07:28.400759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1447/2997] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:28 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:28.521721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:28.532278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7b76b6df-b581-4b94-8027-a813bcedf830 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.172062 Aug 29 23:07:28.532739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1551/2998] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:28.763222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:28.763767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:28.771337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:28.771754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:28.772192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:28.772898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:28.773338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:28.773750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:28.855833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:28.864615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:28.865840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:28.866958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e0ca2963-6008-4605-a23b-965c3b73e7f4 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1333 microversion: 2.20 time: 0.108081 Aug 29 23:07:28.867513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1448/2999] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:28 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:29.411439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:29.412784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:29.420400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:29.421966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:29.422996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:29.423775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:29.424269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:29.424885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:29.557722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:29.558526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:29.567558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:29.568480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:29.569476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:29.570473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:29.571188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:29.571854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:29.575412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:29.586134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1f817bf3-aabc-408f-ab36-83a7e5e4d58a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.179823 Aug 29 23:07:29.586950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1552/3000] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:29 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:29.791160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:29.801720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-28ed23ac-1763-4e7e-a69a-7f50436c1536 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.250223 Aug 29 23:07:29.802307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1449/3001] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:29.893775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:29.894642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:29.900749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:29.901252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:29.901695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:29.902634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:29.903098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:29.903662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:30.096985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:30.107015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:30.109968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:30.111226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-631491c1-24bd-4781-95a4-6ac261f8dfea tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1406 microversion: 2.20 time: 0.221898 Aug 29 23:07:30.112461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1553/3002] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:29 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:30.607758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:30.609260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:30.616333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:30.616819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:30.617306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:30.618019 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:30.618461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:30.618887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:30.824625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:30.825323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:30.832197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:30.836486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:30.836486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:30.836486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:30.836486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:30.837557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:30.861865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:30.866615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:30.876224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c12a97fd-cdab-45b2-9860-1f1d4c869589 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.271973 Aug 29 23:07:30.882501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1450/3003] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:30 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:30.988880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:30.998612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d34ee83a-6502-490a-a89e-342de48e7a76 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.177809 Aug 29 23:07:30.999236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1554/3004] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:31.046583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-85801b6e-9a58-4504-8ebb-f7d2ce13806f req-88c6078c-a890-4099-af79-e7b6e8964eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28f7280f-a6e7-4027-9944-e320745e284b", "tag": "3471a251-7b66-4aee-856f-19413b4e8340"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:07:31.057923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-85801b6e-9a58-4504-8ebb-f7d2ce13806f req-88c6078c-a890-4099-af79-e7b6e8964eac service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:31.058408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-85801b6e-9a58-4504-8ebb-f7d2ce13806f req-88c6078c-a890-4099-af79-e7b6e8964eac service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:31.058840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-85801b6e-9a58-4504-8ebb-f7d2ce13806f req-88c6078c-a890-4099-af79-e7b6e8964eac service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:31.070454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-85801b6e-9a58-4504-8ebb-f7d2ce13806f req-88c6078c-a890-4099-af79-e7b6e8964eac service nova] Creating event network-changed:3471a251-7b66-4aee-856f-19413b4e8340 for instance 28f7280f-a6e7-4027-9944-e320745e284b on hv-cinder-85426 Aug 29 23:07:31.075230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-85801b6e-9a58-4504-8ebb-f7d2ce13806f req-88c6078c-a890-4099-af79-e7b6e8964eac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032515 Aug 29 23:07:31.078685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1451/3005] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:07:31.137288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:31.138490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:31.149840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:31.150410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:31.151021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:31.151821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:31.152329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:31.152758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:31.300347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:31.316114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:31.317583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:31.318694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ea377841-2f74-4bec-b8c9-b03840dde630 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1406 microversion: 2.20 time: 0.187556 Aug 29 23:07:31.319262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1555/3006] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:31 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:07:31.899237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:31.903550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:31.904355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:31.911364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:31.911847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:31.912321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:31.913005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:31.913455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:31.913875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:32.020287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:32.021030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:32.027521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:32.027991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:32.028467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:32.029194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:32.029646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:32.030277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:32.056092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:32.065740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9d50e3a8-d727-4291-8f16-1ddadcfd5c3f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.167764 Aug 29 23:07:32.066248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1452/3007] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:31 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:32.168501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:32.177496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fb445f39-b8ab-4027-ae2e-402cbb3817e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.161832 Aug 29 23:07:32.178080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1556/3008] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:32.342772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:32.343284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:32.349862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:32.350334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:32.350758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:32.351443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:32.351886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:32.352330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:32.493763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:32.502421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:32.503914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:32.505051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d96a1a1f-f2e5-4240-9de2-99f599724d31 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1406 microversion: 2.20 time: 0.166792 Aug 29 23:07:32.505855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1453/3009] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:32 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:33.087173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:33.087780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:33.095347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:33.098055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:33.098055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:33.098055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:33.098055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:33.098507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:33.198891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:33.199531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:33.207114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:33.212724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:33.212724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:33.212724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:33.212724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:33.213186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:33.239780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:33.248705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8e86b968-61fe-400a-a0d0-d3f471a598ee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.165383 Aug 29 23:07:33.250089 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1557/3010] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:33 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:33.341517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:33.350384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dbecfaba-c18e-4a24-9674-d9ebc5eee7c8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155341 Aug 29 23:07:33.351066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1454/3011] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:33.529074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:33.529660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:33.531763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:33.536729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:33.537217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:33.537686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:33.538390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:33.538848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:33.539284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:33.543782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:33.680271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:33.689780 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:33.691240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:33.692399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-add4a9f2-4ac2-4fb0-b7de-629e25a0293a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1406 microversion: 2.20 time: 0.167347 Aug 29 23:07:33.692969 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1558/3012] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:33 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:34.270543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:34.271092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:34.277489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:34.282098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:34.282098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:34.282098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:34.282098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:34.282532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:34.372490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:34.373175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:34.380710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:34.381201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:34.381638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:34.382332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:34.382792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:34.383329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:34.417313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:34.431616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7f509721-0b6f-4383-9e72-99260baa6a31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164688 Aug 29 23:07:34.432238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1455/3013] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:34 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:34.537559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:34.546172 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2b22ae50-eb93-4927-ba19-f80065bf10ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.177372 Aug 29 23:07:34.546763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1559/3014] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:34 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:34.729476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:34.730090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:34.737079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:34.737604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:34.738020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:34.738714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:34.739166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:34.739590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:34.873286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:34.884183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:34.885633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:34.886864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a7ab1329-cf60-429c-b90e-4ff3c303fc26 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1406 microversion: 2.20 time: 0.161378 Aug 29 23:07:34.887441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1456/3015] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:34 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:35.453959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:35.454554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:35.460889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:35.461366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:35.461795 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:35.462478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:35.462931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:35.463350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:35.567467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:35.568794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:35.571195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=16 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:35.576455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:35.577104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:35.577515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:35.578158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:35.578608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:35.579795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:35.604813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:35.614386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-01aa4aba-6819-4e94-a3a9-8c8965f90313 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164796 Aug 29 23:07:35.615184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1560/3016] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:35 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:35.734204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:35.742936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-96001db2-1c30-40f9-8f92-7d62ffc61738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.179189 Aug 29 23:07:35.743511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1457/3017] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:35.910097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:35.910712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:35.918577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:35.919311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:35.919966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:35.921858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:35.922638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:35.923200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:36.059539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:36.068906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:36.070366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:36.071567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4ed73723-c434-400a-84bf-ad25ef1231a5 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1406 microversion: 2.20 time: 0.165499 Aug 29 23:07:36.072167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1561/3018] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:35 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:36.636241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:36.636863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:36.643556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:36.644040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:36.644494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:36.645176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:36.645625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:36.646044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:36.765212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:36.765813 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:36.772381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:36.772858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:36.773291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:36.773994 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:36.774442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:36.774858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:36.782620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:36.792264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6f96b223-16cb-4c31-ab89-6cb38075b931 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159898 Aug 29 23:07:36.792852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1458/3019] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:36 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:36.911902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:36.921639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1c48bb7d-b11c-44d1-91b8-45197ecc1304 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.159515 Aug 29 23:07:36.922000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1562/3020] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:37.096405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:37.096938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:37.103036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:37.103522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:37.103961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:37.104705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:37.105162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:37.105585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:37.237918 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:37.246353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:37.248106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:37.248943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d65b5ca0-1310-4dcf-9f01-e57d7ac97ed6 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1406 microversion: 2.20 time: 0.157568 Aug 29 23:07:37.249531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1459/3021] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:37 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:37.816678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:37.817581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:37.820623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-3bada157-1f0e-43bf-91a2-96872651d3b3 req-3b979b7d-ad8a-430d-912c-11ff7eed87e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f7280f-a6e7-4027-9944-e320745e284b", "name": "network-vif-plugged", "status": "completed", "tag": "3471a251-7b66-4aee-856f-19413b4e8340"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:07:37.824676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:37.825171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:37.825606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:37.826288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:37.826895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:37.827657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:37.830367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-3bada157-1f0e-43bf-91a2-96872651d3b3 req-3b979b7d-ad8a-430d-912c-11ff7eed87e8 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:37.830945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-3bada157-1f0e-43bf-91a2-96872651d3b3 req-3b979b7d-ad8a-430d-912c-11ff7eed87e8 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:37.831388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-3bada157-1f0e-43bf-91a2-96872651d3b3 req-3b979b7d-ad8a-430d-912c-11ff7eed87e8 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:37.842598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-3bada157-1f0e-43bf-91a2-96872651d3b3 req-3b979b7d-ad8a-430d-912c-11ff7eed87e8 service nova] Creating event network-vif-plugged:3471a251-7b66-4aee-856f-19413b4e8340 for instance 28f7280f-a6e7-4027-9944-e320745e284b on hv-cinder-85426 Aug 29 23:07:37.847998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-3bada157-1f0e-43bf-91a2-96872651d3b3 req-3b979b7d-ad8a-430d-912c-11ff7eed87e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224261 Aug 29 23:07:37.848646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1563/3022] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:07:37.948967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:37.949848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:37.957321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:37.958180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:37.958725 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:37.959486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:37.960016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:37.960533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:37.999212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:38.009163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-071a7afc-c5d2-498d-8cdc-391f67f69b1c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.198373 Aug 29 23:07:38.009785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1460/3023] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:37 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:38.110074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:38.118626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0f032df0-be6e-44b4-9d31-5be0054d54c7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.174889 Aug 29 23:07:38.119204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1564/3024] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:38.271717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:38.272391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:38.278382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:38.278859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:38.279292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:38.280205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:38.280902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:38.281330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:38.422620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:38.431471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:38.432868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:38.433968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7a95101a-d172-432f-be5c-c23638b22e62 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1406 microversion: 2.20 time: 0.166134 Aug 29 23:07:38.434516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1461/3025] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:38 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:39.032757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:39.033378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:39.040305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:39.040856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:39.041314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:39.042011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:39.042464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:39.042915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:39.141224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:39.141992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:39.148952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:39.149330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:39.149764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:39.150481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:39.150962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:39.151335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:39.181996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:39.191149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-648a4278-2fda-4312-b190-e94a89286637 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.162557 Aug 29 23:07:39.191801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1565/3026] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:39 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:39.285266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:39.293690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-72fd78cb-73ec-483d-bb62-1f73c23bb640 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157267 Aug 29 23:07:39.294295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1462/3027] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:39.457067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:39.457607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:39.463466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:39.463944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:39.464419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:39.465109 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:39.465557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:39.465976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:39.606391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:39.615511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:39.616980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:39.618091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-108cef99-b770-4437-9ddf-59dafb9c2dbe tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1406 microversion: 2.20 time: 0.165056 Aug 29 23:07:39.618642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1566/3028] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:39 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:07:40.214964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:40.215566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:40.223189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:40.223703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:40.224173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:40.224860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:40.225314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:40.225741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:40.315455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:40.316078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:40.322823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:40.323313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:40.323756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:40.324492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:40.324952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:40.325380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:40.365554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:40.375242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-21ebe17c-bb62-43a7-b408-070fa0ff9b2a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164420 Aug 29 23:07:40.375821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1463/3029] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:40 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:40.465955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:40.474295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ba626bdb-66d3-4dec-9f38-b490ef40f18d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163387 Aug 29 23:07:40.476520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1567/3030] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:40 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:07:40.641253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:40.641866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:40.648026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:40.648545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:40.649013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:40.649709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:40.650162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:40.650585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:40.785500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:40.793764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:40.795880 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:40.797056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8c1e6b2b-bde8-43e3-8c0d-b313494e32dc tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1597 microversion: 2.20 time: 0.160353 Aug 29 23:07:40.797623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1464/3031] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:07:40 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:07:40.819680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df51e4e2-0b85-4107-bf39-f42c1a5f0e5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:40.820215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-df51e4e2-0b85-4107-bf39-f42c1a5f0e5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:40.826581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df51e4e2-0b85-4107-bf39-f42c1a5f0e5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:40.827074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df51e4e2-0b85-4107-bf39-f42c1a5f0e5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:40.827514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df51e4e2-0b85-4107-bf39-f42c1a5f0e5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:40.828246 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df51e4e2-0b85-4107-bf39-f42c1a5f0e5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:40.828709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df51e4e2-0b85-4107-bf39-f42c1a5f0e5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:40.829138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df51e4e2-0b85-4107-bf39-f42c1a5f0e5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:40.917177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-df51e4e2-0b85-4107-bf39-f42c1a5f0e5d tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098341 Aug 29 23:07:40.917177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1568/3032] 10.222.0.59 () {60 vars in 1316 bytes} [Mon Aug 29 23:07:40 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:07:41.401844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:41.402961 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:41.416545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:41.417524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:41.418285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:41.419631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:41.421782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:41.422600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:41.497233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:41.498220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:41.505450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:41.505932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:41.506639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:41.507305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:41.507938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:41.508575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:41.582766 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:41.591689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3cc71b8f-af95-4b54-9da6-ee8b5a7955d4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.197957 Aug 29 23:07:41.592425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1465/3033] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:41 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:41.761805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:41.770388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a5740aac-b499-47ba-8e82-1189d04ac436 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.278822 Aug 29 23:07:41.770985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1569/3034] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:42.345253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-0289419f-4f20-47b2-91e0-9e5ed413eacb req-f56d5fb9-4c65-4314-8231-5bbc9e79748f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28f7280f-a6e7-4027-9944-e320745e284b", "tag": "3471a251-7b66-4aee-856f-19413b4e8340"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:07:42.354643 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-0289419f-4f20-47b2-91e0-9e5ed413eacb req-f56d5fb9-4c65-4314-8231-5bbc9e79748f service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:42.355115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-0289419f-4f20-47b2-91e0-9e5ed413eacb req-f56d5fb9-4c65-4314-8231-5bbc9e79748f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:42.355545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-0289419f-4f20-47b2-91e0-9e5ed413eacb req-f56d5fb9-4c65-4314-8231-5bbc9e79748f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:42.369919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-0289419f-4f20-47b2-91e0-9e5ed413eacb req-f56d5fb9-4c65-4314-8231-5bbc9e79748f service nova] Creating event network-changed:3471a251-7b66-4aee-856f-19413b4e8340 for instance 28f7280f-a6e7-4027-9944-e320745e284b on hv-cinder-85426 Aug 29 23:07:42.375222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-0289419f-4f20-47b2-91e0-9e5ed413eacb req-f56d5fb9-4c65-4314-8231-5bbc9e79748f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096082 Aug 29 23:07:42.376011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1466/3035] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:07:42.616900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:42.617506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:42.624276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:42.624853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:42.625520 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:42.626226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:42.626857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:42.627453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:42.776071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:42.785731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a5d01475-d71d-46f8-8b6d-1eb66574e869 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.172569 Aug 29 23:07:42.787041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1570/3036] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:42 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:42.796063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:42.798896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:42.806703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:42.807224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:42.813433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:42.813433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:42.813433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:42.813433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:43.081882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:43.091138 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-33fdbd0f-7a19-4ed9-8493-1899c306a851 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.302695 Aug 29 23:07:43.100728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1467/3037] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:43.808073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:43.808714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:43.816419 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:43.816903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:43.817336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:43.818027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:43.818473 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:43.818906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:43.955890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:43.964321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0dbfc57a-554c-410d-afdf-c0ae54e298e5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160293 Aug 29 23:07:43.964898 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1571/3038] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:43 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:44.113335 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:44.113947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:44.120806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:44.121282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:44.121716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:44.122416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:44.122870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:44.123291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:44.255158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:44.258671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:44.263692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dd066608-3815-4745-81c5-daa91d9bef27 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.154215 Aug 29 23:07:44.264472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1468/3039] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:44.987744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:44.988425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:44.996240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:44.997023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:44.997177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:44.997859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:44.998809 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:44.999230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:45.154656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:45.163208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1f3f1b2d-db77-4d41-9d51-caf3f2ee2563 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.181381 Aug 29 23:07:45.163800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1572/3040] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:44 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:45.285112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:45.285673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:45.292416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:45.292895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:45.293328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:45.294007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:45.294457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:45.295410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:45.435150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:45.444214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bc071a19-7dc0-46ab-9b2d-4a573f75f611 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163059 Aug 29 23:07:45.444792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1469/3041] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:46.188177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:46.188732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:46.195260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:46.195749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:46.196220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:46.196929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:46.197387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:46.197822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:46.339673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:46.349326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7fcffb93-e7d7-49a6-bd7d-840405fba0b9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.165729 Aug 29 23:07:46.349919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1573/3042] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:46 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:46.467790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:46.468463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:46.475200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:46.475688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:46.476122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:46.476851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:46.477305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:46.478168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:46.611999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:46.621092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8b74267f-8de7-4c57-970e-e0628e92edee tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157954 Aug 29 23:07:46.621705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1470/3043] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:47.371082 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:47.371726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:47.378919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:47.379412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:47.379848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:47.380583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:47.381041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:47.381469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:47.517332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:47.526072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c8661925-e43a-4f30-b5a7-0829b78c7e71 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158862 Aug 29 23:07:47.526666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1574/3044] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:47 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:47.643284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:47.643876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:47.650439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:47.650920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:47.651352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:47.652044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:47.652523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:47.652944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:47.786232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:47.794546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-30f2f31f-5d95-4f28-80b2-1a972d36a326 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155528 Aug 29 23:07:47.795807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1471/3045] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:47 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:48.547824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:48.548541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:48.555753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:48.556513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:48.556942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:48.557644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:48.558091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:48.558510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:48.694538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:48.698391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:48.704227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-78202751-c1bf-43ff-be48-db275255efec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160545 Aug 29 23:07:48.704857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1575/3046] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:48 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:48.817651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:48.818267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:48.824855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:48.825322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:48.825777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:48.827062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:48.827514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:48.827936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:48.959748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:48.968445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-85fdf2b2-b1a6-433d-8f24-3afac7d7d0ba tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.154706 Aug 29 23:07:48.969012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1472/3047] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:49.726417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:49.726979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:49.733887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:49.734370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:49.734803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:49.735503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:49.735950 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:49.736404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:49.872788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:49.881420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e10a448d-4aa1-40bb-a93c-8238dcfdad37 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159247 Aug 29 23:07:49.882005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1576/3048] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:49 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:49.991489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:49.992114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:49.998814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:49.999298 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:49.999731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:50.000466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:50.000920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:50.001344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:50.146232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:50.155130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c93a9aea-44e4-423e-ae2f-663cf917ad43 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.167526 Aug 29 23:07:50.155716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1473/3049] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:50.903046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:50.903697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:50.906173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=70 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:50.911279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:50.913829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:50.913829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:50.913829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:50.913829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:50.914242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:51.050449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:51.059099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f6c77601-4f58-4b32-8753-c29ae3961523 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159923 Aug 29 23:07:51.059673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1577/3050] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:50 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:51.177433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:51.178027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:51.180447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:07:51.185622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:51.186106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:51.186544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:51.187238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:51.187693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:51.188123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:51.325717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:51.334544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-45eac44e-b836-407a-a0a1-e3c41f4e103c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.161470 Aug 29 23:07:51.335124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1474/3051] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:52.081158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:52.081786 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:52.088284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:52.088771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:52.089206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:52.089895 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:52.090357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:52.090782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:52.222677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:52.231426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a424b373-5626-411a-9665-93ee5886429e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154265 Aug 29 23:07:52.232023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1578/3052] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:52 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:52.359929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:52.360561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:52.367089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:52.367574 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:52.368024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:52.368737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:52.369217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:52.369642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:52.501603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:52.510054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7fcb538d-205b-4a81-998a-aaf99d767976 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.154078 Aug 29 23:07:52.510629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1475/3053] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:53.252471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:53.253033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:53.259544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:53.260028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:53.260581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:53.261284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:53.261740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:53.262167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:53.403573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:53.412690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-184ef6c1-3e59-482c-8ba6-7103e2303ca2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164536 Aug 29 23:07:53.413274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1579/3054] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:53 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:53.534078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:53.534685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:53.541211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:53.541683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:53.542110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:53.542794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:53.543231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:53.543642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:53.681313 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:53.689820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2c764080-e473-478a-83e8-5c17963a0d41 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160730 Aug 29 23:07:53.690397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1476/3055] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:53 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:54.434868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:54.435482 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:54.442398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:54.442872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:54.443300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:54.443987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:54.444470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:54.444887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:54.581450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:54.589963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ac05b880-0dfb-422e-83e8-5573501dd481 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159361 Aug 29 23:07:54.590845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1580/3056] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:54 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:54.712210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:54.712782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:54.719857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:54.720374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:54.720813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:54.721506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:54.721960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:54.722384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:54.865782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:54.874613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7a509d12-20b5-4915-aeea-5b85f0837103 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166410 Aug 29 23:07:54.875231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1477/3057] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:55.613080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:55.613737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:55.620956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:55.621434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:55.621863 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:55.622589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:55.623040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:55.623459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:55.771573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:55.774359 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-75b49ca2-deef-4b0b-b4f5-453b1f5953cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.165356 Aug 29 23:07:55.774979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1581/3058] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:55 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:55.898021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:55.898616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:55.905668 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:55.906149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:55.906577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:55.907254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:55.907699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:55.908114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:56.042688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:56.051789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9f8afda5-c8b1-47c3-86cb-08423c5510f6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157637 Aug 29 23:07:56.052415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1478/3059] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:56.795997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:56.797174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:56.806728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:56.807205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:56.807646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:56.808389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:56.808841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:56.809255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:56.942259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:56.950619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f6f0744d-e124-461f-8d9a-84ea0d488d5a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158638 Aug 29 23:07:56.951190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1582/3060] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:56 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:57.075237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:57.075829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:57.082462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:57.082936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:57.083365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:57.084039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:57.084508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:57.084926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:57.216932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:57.226242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c9759388-1405-4a05-9e8d-25a1cfe98722 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.154891 Aug 29 23:07:57.226822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1479/3061] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:57.971973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:57.972610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:57.979067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:57.979544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:57.979979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:57.980702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:57.981158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:57.981579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:58.117611 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:58.126025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-adbcd1f6-dcca-49e9-88f8-95312193500a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158713 Aug 29 23:07:58.126603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1583/3062] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:57 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:58.247226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:58.247846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:58.254604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:58.255085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:58.255517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:58.256242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:58.256699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:58.257123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:58.395607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:58.404213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fd9794e2-b8e4-43c1-b3e9-f440dc83c649 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160896 Aug 29 23:07:58.404775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1480/3063] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:59.154779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:59.155401 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:59.162516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:59.163048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:59.163497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:59.164233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:59.164693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:59.165122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:59.302765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:59.311504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a49ca4e1-9c76-4c1b-8b77-ccbc6da391d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160705 Aug 29 23:07:59.312626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1584/3064] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:59 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:07:59.427158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:07:59.427797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:07:59.434751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:59.435240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:59.435683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:59.436424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:07:59.437457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:07:59.437883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:07:59.577545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:07:59.585997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-01ca5ecf-182d-468c-a72d-9813178496ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162668 Aug 29 23:07:59.586578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1481/3065] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:07:59 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:00.333078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:00.333646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:00.340064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:00.340582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:00.341034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:00.341713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:00.342165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:00.342590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:00.475777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:00.484594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a364e667-6988-4762-9cf6-88cd3f0528c0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155430 Aug 29 23:08:00.485208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1585/3066] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:00 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:00.607455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:00.608147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:00.615533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:00.616017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:00.616614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:00.617303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:00.617755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:00.618202 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:00.745224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:00.753744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ba0c4c79-c43f-4925-9c93-a1099f04210e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.150212 Aug 29 23:08:00.754348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1482/3067] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:01.506251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:01.506872 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:01.513383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:01.513866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:01.514297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:01.515650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:01.516117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:01.516563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:01.651875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:01.660281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5c2d635d-22ca-4aad-a133-a4be5dbd3919 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157883 Aug 29 23:08:01.660858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1586/3068] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:01 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:01.774641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:01.775232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:01.781646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:01.782128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:01.782561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:01.783287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:01.783745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:01.784196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:01.918702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:01.928010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7f71ca80-5fb6-423f-af0c-c89915153d1a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157226 Aug 29 23:08:01.931490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1483/3069] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:02.681735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:02.682340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:02.689576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:02.690061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:02.690494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:02.691191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:02.691643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:02.692063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:02.829897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:02.839297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b5e79cf5-d6c0-49a4-8662-0ffd894e3cf7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161689 Aug 29 23:08:02.839888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1587/3070] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:02 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:02.950343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:02.951290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:02.964516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:02.965003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:02.965437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:02.966131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:02.966588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:02.967011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:03.119945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:03.129913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c452710b-ed7c-4016-9f48-a68ed3a8bd6c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.183517 Aug 29 23:08:03.130499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1484/3071] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:03.861420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:03.862009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:03.868823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:03.869302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:03.869730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:03.870412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:03.870858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:03.871275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:04.015284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:04.023687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-af65fdfe-dbb2-4d13-abba-79608769940c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.166218 Aug 29 23:08:04.024286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1588/3072] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:03 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:04.152097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:04.152734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:04.160059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:04.160605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:04.161004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:04.161699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:04.162145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:04.162568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:04.181420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:04.295673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:04.303487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eacca415-2221-4dac-a856-b44577dba376 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155303 Aug 29 23:08:04.304066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1485/3073] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:05.045102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:05.045736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:05.053845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:05.054340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:05.054783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:05.055797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:05.056283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:05.056737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:05.200798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:05.210040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c8fdc762-fc32-4847-9cca-9f0763e480cf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.168769 Aug 29 23:08:05.210604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1589/3074] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:05 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:05.326485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:05.327070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:05.334488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:05.335016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:05.335513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:05.336429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:05.336904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:05.337326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:05.501155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:05.510173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c79ba5ed-1dae-4074-b1f9-8e1e36bedfa6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.188146 Aug 29 23:08:05.510758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1486/3075] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:05 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:06.230868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:06.231577 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:06.238021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:06.238493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:06.238918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:06.239591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:06.240045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:06.240488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:06.379362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:06.387803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-28e90be6-4f84-46a8-8574-847a6977c1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160900 Aug 29 23:08:06.388446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1590/3076] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:06 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:06.531527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:06.532218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:06.538634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:06.539110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:06.539546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:06.540253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:06.540711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:06.541131 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:06.676887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:06.677535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2f4f5e52-4579-44f1-8521-043ccaeccdb0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.149926 Aug 29 23:08:06.678141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1487/3077] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:07.410719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:07.411331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:07.417943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:07.418426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:07.418856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:07.419547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:07.419997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:07.420444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:07.551503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:07.560193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fe6b6b4a-deab-4cd3-b00d-fd52f676c0aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153686 Aug 29 23:08:07.560789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1591/3078] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:07 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:07.699651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:07.700309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:07.706718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:07.707197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:07.707627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:07.708353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:07.708804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:07.709224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:07.845800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:07.854338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fff57cac-deed-4c37-b11c-ceced7dadc53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158621 Aug 29 23:08:07.854919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1488/3079] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:08.582784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:08.583484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:08.590824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:08.591326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:08.591768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:08.592509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:08.592970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:08.593396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:08.612345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:08.723578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:08.731899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a1040d15-59d5-4564-beb7-8380388e0206 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153673 Aug 29 23:08:08.732515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1592/3080] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:08 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:08.876198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:08.876834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:08.883943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:08.884448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:08.884879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:08.885551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:08.885997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:08.886412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:09.017123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:09.026642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a22560ae-a49d-4b20-a3a2-79e4212a0483 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.154238 Aug 29 23:08:09.027292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1489/3081] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:09.753100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:09.753704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:09.760396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:09.760910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:09.761346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:09.762048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:09.762509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:09.762932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:09.901574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:09.910388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9fc65c5c-0f8f-40b0-a57d-4c746fda485c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161242 Aug 29 23:08:09.910962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1593/3082] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:09 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:10.047626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:10.048212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:10.055771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:10.056278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:10.056719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:10.057392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:10.057838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:10.058255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:10.195805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:10.204159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82f3cadb-e073-47f6-809f-b4c6b391c3e0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160486 Aug 29 23:08:10.204754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1490/3083] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:10.932316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:10.932925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:10.939309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:10.940354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:10.940801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:10.941504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:10.942168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:10.942522 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:11.077122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:11.086504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-618f1483-23ea-4012-813e-fe22214a8603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158503 Aug 29 23:08:11.087079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1594/3084] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:10 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:11.226824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:11.227399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:11.233817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:11.234326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:11.234763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:11.235439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:11.235889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:11.236348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:11.366550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:11.374890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-25953071-dd5d-453f-8388-000092be0104 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.152216 Aug 29 23:08:11.375555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1491/3085] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:11 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:12.107867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:12.108614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:12.115941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:12.116458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:12.116903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:12.117629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:12.118084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:12.118510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:12.263132 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:12.272046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f1e7dd95-78f5-4a75-955e-ef87037c49ca tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.167991 Aug 29 23:08:12.272674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1595/3086] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:12 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:12.397587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:12.398770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:12.404959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:12.405440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:12.405877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:12.406569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:12.407028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:12.407454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:12.542065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:12.550727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-09215809-46c9-4f11-a8d1-e2c3523b2952 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157174 Aug 29 23:08:12.551333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1492/3087] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:13.293382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:13.294023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:13.300674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:13.301169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:13.301603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:13.302301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:13.302759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:13.303189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:13.439823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:13.448384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-588a965a-8ac5-4d6f-b645-3285a9a5aab7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158714 Aug 29 23:08:13.448949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1596/3088] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:13 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:13.572680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:13.573282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:13.579747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:13.580250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:13.580685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:13.581396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:13.582405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:13.582822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:13.715400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:13.723955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5b9f886e-acca-499b-a52d-6c3a1597ad3f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155084 Aug 29 23:08:13.724651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1493/3089] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:14.473748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:14.474404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:14.485697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:14.486720 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:14.487340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:14.488707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:14.489553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:14.490276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:14.650978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:14.659934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c4b70ea0-c5fb-40ae-a3ea-28acc06daa54 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.190044 Aug 29 23:08:14.660670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1597/3090] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:14 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:14.748388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:14.749393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:14.760469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:14.761288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:14.762020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:14.763233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:14.764040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:14.764815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:14.908939 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:14.918284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-64f336fc-9b19-4802-a573-472313e0f527 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.176559 Aug 29 23:08:14.918867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1494/3091] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:15.681357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:15.681981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:15.688943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:15.689428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:15.689866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:15.690573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:15.691028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:15.691467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:15.838713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:15.848016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-304299cc-dc2e-4a6d-80d8-5d35eef4dc13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.170785 Aug 29 23:08:15.848648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1598/3092] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:15 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:15.942227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:15.943029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:15.949555 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:15.950037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:15.950462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:15.951150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:15.951603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:15.952023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:16.090811 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:16.099977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2aad496a-d985-42dc-b593-90205a75b4b0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162126 Aug 29 23:08:16.100604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1495/3093] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:16.880574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:16.881205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:16.888259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:16.888751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:16.889191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:16.889899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:16.890360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:16.890793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:17.040529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:17.049077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f4e26dbc-7bbc-4cc5-ba6a-b23c41ba73c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.172788 Aug 29 23:08:17.049648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1599/3094] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:16 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:17.246113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:17.246726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:17.252699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:17.253819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:17.254254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:17.254935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:17.255384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:17.255812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:17.398277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:17.407273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8ae61b6f-0583-4ef1-8ec0-f5f362027857 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.287984 Aug 29 23:08:17.411243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1496/3095] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:18.075686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:18.076326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:18.083344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:18.083843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:18.084320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:18.085034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:18.085494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:18.085918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:18.224734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:18.233168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b2358adb-641c-466c-b47c-df9fec39f1a7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161494 Aug 29 23:08:18.233752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1600/3096] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:18 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:18.430814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:18.431493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:18.438615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:18.438899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:18.439345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:18.440054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:18.440650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:18.441912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:18.446513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-83e38c68-3f7b-4cd1-bbcc-cfe8b494a2cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:18.447193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-83e38c68-3f7b-4cd1-bbcc-cfe8b494a2cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:18.453730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e38c68-3f7b-4cd1-bbcc-cfe8b494a2cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:18.454218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e38c68-3f7b-4cd1-bbcc-cfe8b494a2cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:18.460833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e38c68-3f7b-4cd1-bbcc-cfe8b494a2cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:18.460833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e38c68-3f7b-4cd1-bbcc-cfe8b494a2cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:18.460833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e38c68-3f7b-4cd1-bbcc-cfe8b494a2cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:18.460833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83e38c68-3f7b-4cd1-bbcc-cfe8b494a2cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:18.491333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-83e38c68-3f7b-4cd1-bbcc-cfe8b494a2cf tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b/ips" status: 200 len: 150 microversion: 2.20 time: 0.050498 Aug 29 23:08:18.492469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1601/3097] 10.222.0.59 () {60 vars in 1289 bytes} [Mon Aug 29 23:08:18 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:08:18.649513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:18.658261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-08f46e94-9905-4249-9db1-44aa4d2c1fef tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.232086 Aug 29 23:08:18.658863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1497/3098] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:18 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:19.255704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:19.256447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:19.263105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:19.263514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:19.263953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:19.264700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:19.265159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:19.265587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:19.401667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:19.410713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-de73e7df-caed-4d46-99a5-2d35d1d9e1d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159446 Aug 29 23:08:19.411304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1602/3099] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:19 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:19.681008 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:19.681677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:19.688542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:19.689030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:19.689468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:19.690181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:19.690694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:19.691314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:19.836820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:19.845260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-087a287c-f637-465d-a249-89f44df4d564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.168621 Aug 29 23:08:19.845868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1498/3100] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:19 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:20.432739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:20.433610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:20.440223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:20.440905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:20.441347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:20.442059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:20.442511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:20.442931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:20.585853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:20.594363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d1b5a546-ce4f-4414-bd77-69d030d36855 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.165848 Aug 29 23:08:20.594944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1603/3101] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:20 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:20.868216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:20.868956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:20.875413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:20.875896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:20.876367 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:20.877065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:20.877709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:20.878360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:21.027802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:21.038794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fb649091-4c86-428f-ad73-6f6f0a91d9fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.174490 Aug 29 23:08:21.043545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1499/3102] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:21.618634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:21.619355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:21.621729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=54 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:21.626556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:21.627046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:21.627484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:21.629074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:21.629546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:21.630034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:21.769319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:21.778338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cdb59793-3cd1-4eed-a016-1fd1ba2a9028 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.165786 Aug 29 23:08:21.778991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1604/3103] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:21 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:22.061581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:22.062338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:22.064467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=52 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:22.069405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:22.069917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:22.070347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:22.071050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:22.071509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:22.071934 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:22.208595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:22.216970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3a03dc16-d50d-4ac8-960a-33949ae52565 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.159374 Aug 29 23:08:22.217558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1500/3104] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:22 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:22.799773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:22.800737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:22.807626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:22.808113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:22.808573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:22.809273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:22.809728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:22.810154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:22.953464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:22.962533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4c0d7624-31b4-4786-b868-ad36ddee1c24 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.166678 Aug 29 23:08:22.963127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1605/3105] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:22 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:23.239990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:23.240659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:23.248084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:23.248591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:23.249023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:23.249712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:23.250157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:23.250577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:23.389865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:23.398383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-efd48219-58e4-45e8-8c09-26dd99b987bb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163143 Aug 29 23:08:23.398965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1501/3106] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:23 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:23.987228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:23.988009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:23.995020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:23.995507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:23.995942 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:23.996674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:23.997130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:23.997556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:24.138222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:24.147889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-639021e6-8e1f-41a5-b54a-56120147be68 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.167712 Aug 29 23:08:24.148521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1606/3107] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:23 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:24.420112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:24.420751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:24.428106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:24.428634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:24.429069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:24.430023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:24.430476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:24.430897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:24.435198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:24.589789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:24.598682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-65efcb4b-ca48-4ce7-ac3e-aa5278a88e53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.182452 Aug 29 23:08:24.599279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1502/3108] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:24 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:25.181881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:25.182452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:25.189258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:25.189737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:25.190169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:25.191398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:25.191847 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:25.192292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:25.329414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:25.338552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-48b18584-4249-43ba-babf-f8f8be508dd5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160985 Aug 29 23:08:25.339134 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1607/3109] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:25 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:25.627108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:25.628236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:25.635105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:25.635589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:25.636024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:25.636740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:25.637191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:25.637611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:25.783582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:25.792342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-86a3d04f-5ad4-4c32-9ead-f928b8057f55 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.169066 Aug 29 23:08:25.792929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1503/3110] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:25 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:26.359839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:26.360508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:26.367993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:26.368512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:26.368941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:26.369632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:26.370080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:26.370493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:26.511943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:26.520416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-28649b98-f2a8-41b6-b7ce-cd0337a9b47e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164575 Aug 29 23:08:26.520990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1608/3111] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:26 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:26.814243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:26.814855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:26.827330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:26.827821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:26.828322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:26.829106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:26.829576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:26.830022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:26.979289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:26.987771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dd1151fb-b109-4b1a-923e-08ee82d63ed9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.177463 Aug 29 23:08:26.988395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1504/3112] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:26 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:27.541912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:27.542697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:27.549084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:27.549569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:27.550400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:27.550714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:27.551173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:27.551599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:27.571322 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:27.709030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:27.717939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c5d9f618-2073-4078-aa1e-b3743ad5ff47 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.180164 Aug 29 23:08:27.718535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1609/3113] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:27 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:28.009927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:28.010543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:28.017172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:28.017652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:28.018085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:28.019583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:28.020212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:28.020639 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:28.157404 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:28.166482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c983e012-826b-40f8-882c-0d80b218a8e7 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160432 Aug 29 23:08:28.167351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1505/3114] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:28 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:28.740011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:28.740645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:28.747588 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:28.748254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:28.748804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:28.749606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:28.750170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:28.750702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:28.898896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:28.907448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4d870f90-f470-4036-b8e4-aba8c8cc1872 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.171522 Aug 29 23:08:28.908106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1610/3115] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:28 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:29.188881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:29.189526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:29.197563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:29.198062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:29.198493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:29.199200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:29.199654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:29.200083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:29.343993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:29.354606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3e1b58be-2a53-4997-a9ff-1f78edd05939 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.169567 Aug 29 23:08:29.355251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1506/3116] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:29 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:29.929002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:29.930077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:29.937463 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:29.938006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:29.938487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:29.939259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:29.939823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:29.941056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:30.084927 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:30.093564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c2859504-8d34-44f5-a931-6ccc9c635bb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.169298 Aug 29 23:08:30.094155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1611/3117] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:29 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:30.377772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:30.378483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:30.384893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:30.385374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:30.385830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:30.386519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:30.386968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:30.387396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:30.552128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:30.562379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e5bae74e-affa-41c3-b492-b494813479ff tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.188405 Aug 29 23:08:30.562985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1507/3118] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:30 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:31.125584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:31.126201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:31.133019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:31.133498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:31.133930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:31.134623 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:31.135072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:31.135494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:31.281769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:31.290042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-648f9d9b-6f26-436e-8938-1cf45207ac05 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.168508 Aug 29 23:08:31.290615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1612/3119] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:31 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:31.587412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:31.588118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:31.595698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:31.596989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:31.597645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:31.598416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:31.598933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:31.599431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:31.742030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:31.750616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-20d8d5bb-fe27-432b-8e97-eb77cce57738 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.167970 Aug 29 23:08:31.751225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1508/3120] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:31 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:32.314062 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:32.314788 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:32.322687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:32.323264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:32.323730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:32.324569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:32.325090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:32.325549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:32.473881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:32.482644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a35b4bc5-6d22-41ca-8c72-c4e86fe7caac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.172930 Aug 29 23:08:32.483233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1613/3121] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:32 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:32.772849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:32.773512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:32.780438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:32.780922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:32.781358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:32.782053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:32.782502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:32.782921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:32.933032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:32.942602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2a55f51d-2556-4bda-969e-92673a88005a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.174207 Aug 29 23:08:32.943262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1509/3122] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:32 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:33.506272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:33.506983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:33.514303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:33.514822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:33.515287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:33.516385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:33.516701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:33.517160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:33.653095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:33.662026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6bad5ee4-6e9b-4848-83ba-053753cc2b9c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161065 Aug 29 23:08:33.662662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1614/3123] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:33 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:33.964816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:33.965426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:33.972622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:33.973092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:33.973522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:33.974198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:33.974645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:33.975065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:34.107013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:34.116151 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3c632192-dfed-44a1-866a-8c44dd9f02f9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.155165 Aug 29 23:08:34.116738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1510/3124] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:33 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:34.683877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:34.684512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:34.692002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:34.692508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:34.692948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:34.693747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:34.694204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:34.694626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:34.833453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:34.842984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d4032871-a43a-41b4-ac57-096e767bd669 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.162922 Aug 29 23:08:34.843574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1615/3125] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:34 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:35.137877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:35.138537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:35.145332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:35.145814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:35.146248 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:35.146940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:35.147433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:35.147808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:35.283920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:35.292243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-45fb93e2-9649-4b37-8461-e3e1ec7cc69e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158265 Aug 29 23:08:35.292819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1511/3126] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:35 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:35.863914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:35.864571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:35.871094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:35.871579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:35.872012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:35.872802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:35.873262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:35.873691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:36.006374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:36.016369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f7e20d18-64c5-483f-bda8-9b5ac4ed6976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156380 Aug 29 23:08:36.016956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1616/3127] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:35 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:36.314521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:36.316099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:36.322799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:36.323284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:36.323718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:36.324461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:36.324909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:36.325329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:36.468389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:36.478032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d752194e-099a-4e6a-a10a-59f22774fd98 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.167488 Aug 29 23:08:36.478625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1512/3128] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:36 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:37.037899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:37.038509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:37.045115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:37.045596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:37.046031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:37.046723 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:37.047176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:37.047597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:37.180829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:37.189228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2c5d5bdd-30b1-4d51-b9d2-73ea61aec6f8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155671 Aug 29 23:08:37.190350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1617/3129] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:37 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:37.499156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:37.499690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:37.506339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:37.506817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:37.507252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:37.507935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:37.508409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:37.508833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:37.643441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:37.653997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-439e58f1-3e50-4e66-8f0a-f1ccf731de16 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158856 Aug 29 23:08:37.654575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1513/3130] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:37 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:38.210755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:38.211323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:38.217685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:38.218153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:38.218580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:38.219254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:38.219701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:38.220114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:38.352987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:38.361434 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b3de0d79-75f5-42de-9a04-bc62d7489946 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154586 Aug 29 23:08:38.362745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1618/3131] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:38 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:38.676714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:38.677749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:38.683731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:38.684243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:38.684681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:38.685415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:38.685864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:38.686288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:38.825198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:38.834288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-65b51a19-0f98-4eb9-8d70-422f03c19aed tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162598 Aug 29 23:08:38.834870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1514/3132] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:38 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:39.383506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:39.384127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:39.390909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:39.391386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:39.391816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:39.392550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:39.393004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:39.393422 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:39.539618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:39.548121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-04ce84b8-5daf-4a55-985b-f0d3d3a65a96 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.168460 Aug 29 23:08:39.548727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1619/3133] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:39 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:39.857482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:39.858128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:39.864942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:39.865422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:39.865855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:39.866541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:39.866993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:39.867415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:40.012685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:40.025973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-22dc1238-0fd7-4eda-bce6-abe7f89f0f87 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.172446 Aug 29 23:08:40.026568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1515/3134] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:39 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:40.571630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:40.572417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:40.579376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:40.579859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:40.580334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:40.581039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:40.581593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:40.582015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:40.717299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:40.726706 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f71a9a7c-9c1e-4bd0-acb0-f3c45ba3dc48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159824 Aug 29 23:08:40.727255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1620/3135] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:40 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:41.050515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:41.051172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:41.058527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:41.058976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:41.059412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:41.060110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:41.060587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:41.061010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:41.195123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:41.203358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7a22d185-e992-47ef-98ca-3cde0ee69a2a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158282 Aug 29 23:08:41.203933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1516/3136] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:41 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:41.748641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:41.749355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:41.756092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:41.756616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:41.757056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:41.757759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:41.758220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:41.758664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:41.889461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:41.898648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3dd0471a-bdef-444c-8b30-6a14eaed1813 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153825 Aug 29 23:08:41.899340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1621/3137] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:41 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:42.224974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:42.225619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:42.232231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:42.232800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:42.233242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:42.233940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:42.234393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:42.234817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:42.371956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:42.381218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-07178c11-786d-48ea-9506-0c042ef687c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160168 Aug 29 23:08:42.381806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1517/3138] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:42 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:42.920180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:42.921037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:42.928808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:42.929558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:42.929993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:42.930697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:42.931188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:42.931615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:43.072364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:43.081781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-afab7971-d29b-4ecc-a16d-aace72537815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.165057 Aug 29 23:08:43.082388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1622/3139] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:42 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:43.403027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:43.403630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:43.412319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:43.412807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:43.413242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:43.413949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:43.414405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:43.414833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:43.552056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:43.555815 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:43.561553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d13d293a-32e6-4f74-ba41-88bffeeff0bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.162373 Aug 29 23:08:43.565916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1518/3140] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:43 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:44.103519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:44.104174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:44.110825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:44.111315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:44.112368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:44.113084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:44.113550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:44.113973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:44.254702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:44.263031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-451b0fe3-5a78-473a-813a-85b81d7eca64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.163521 Aug 29 23:08:44.263610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1623/3141] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:44 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:44.584553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:44.585153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:44.592518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:44.593004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:44.593439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:44.594142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:44.594597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:44.595021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:44.748224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:44.758881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2e631044-1ba9-4c8b-9679-2005565b8393 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.178990 Aug 29 23:08:44.766148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1519/3142] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:44 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:45.285248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:45.285869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:45.292614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:45.293101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:45.293559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:45.294263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:45.294721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:45.295157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:45.438238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:45.447074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-76e90fa3-849e-4c3f-ba86-bb360a5c3161 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.166542 Aug 29 23:08:45.447674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1624/3143] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:45 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:45.787633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:45.788233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:45.795062 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:45.795546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:45.795981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:45.796717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:45.797200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:45.797627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:45.934112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:45.943272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c55d0ab8-8db0-4d47-b719-502eec7e119d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160122 Aug 29 23:08:45.943869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1520/3144] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:45 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:46.470254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:46.471140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:46.478643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:46.479135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:46.479574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:46.480340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:46.480799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:46.481227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:46.632092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:46.643382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-86a273b2-ca3a-44c4-a362-bd872680c284 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.176411 Aug 29 23:08:46.644449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1625/3145] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:46 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:46.965567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:46.966173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:46.973047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:46.973534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:46.973974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:46.974674 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:46.975130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:46.975547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:47.109659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:47.118901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2df2ff82-12f6-45d6-afd8-91a67463b825 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157102 Aug 29 23:08:47.119500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1521/3146] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:46 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:47.665900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:47.666536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:47.673031 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:47.673516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:47.674649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:47.675549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:47.676009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:47.676469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:47.680921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:47.819387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:47.829020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e9e231af-6aab-4374-9475-df323003950b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.166652 Aug 29 23:08:47.829626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1626/3147] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:47 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:48.141060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:48.141679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:48.149122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:48.149615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:48.150196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:48.150725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:48.151185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:48.151588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:48.291565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:48.300755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-fd4c60f3-0de3-40ea-906c-c679a6343a7b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163692 Aug 29 23:08:48.301354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1522/3148] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:48 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:48.852092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:48.852784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:48.859481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:48.859975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:48.860445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:48.861893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:48.862368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:48.862800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:49.017626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:49.026454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b4614c58-6202-45c2-b598-020c8e4a2e30 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.178345 Aug 29 23:08:49.027092 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1627/3149] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:48 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:49.322921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:49.323585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:49.330657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:49.331132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:49.331658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:49.332373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:49.332820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:49.333237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:49.476781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:49.485630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2db9dabe-63d8-43e9-9173-d112161caaf0 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.166448 Aug 29 23:08:49.486328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1523/3150] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:49 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:50.067768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:50.068900 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:50.081757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:50.082657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:50.083469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:50.084792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:50.085621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:50.086377 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:50.233620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:50.242603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-89bad8c0-0a1b-4ba3-8f79-832a8ec1df16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.182699 Aug 29 23:08:50.243183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1628/3151] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:50 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:50.507791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:50.508755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:50.519352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:50.519857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:50.520352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:50.521128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:50.521632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:50.522121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:50.683006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:50.691497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5c4debf9-f148-41ce-83be-8e042f64b037 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.188001 Aug 29 23:08:50.692077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1524/3152] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:50 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:51.264533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:51.265558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:51.272711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:51.273194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:51.273621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:51.274313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:51.274754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:51.275224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:51.416277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:51.425490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bb7aeea8-23fc-40d0-bcf1-6d52ba1b5e13 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164900 Aug 29 23:08:51.426069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1629/3153] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:51 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:51.713742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:51.714379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:51.721588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:51.722093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:51.722528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:51.723211 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:51.723661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:51.724084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:51.862099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:51.870295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4b5afa8a-8991-4c12-9894-2be0bd8eaf22 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.160411 Aug 29 23:08:51.871178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1525/3154] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:51 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:52.446509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:52.447253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:52.449559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=52 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:52.454521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:52.455034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:52.455466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:52.456179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:52.456636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:52.457055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:52.593349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:52.602003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c9aead74-5ede-40d4-bb37-0111309a2504 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159462 Aug 29 23:08:52.602573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1630/3155] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:52 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:52.891893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:52.892724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:52.894870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=52 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:52.899816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:52.900342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:52.900779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:52.901471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:52.901926 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:52.902356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:53.047042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:53.056236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5798f2b4-0f30-4d20-95d9-bfad7e0965fc tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.168105 Aug 29 23:08:53.056819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1526/3156] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:52 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:53.623943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:53.624580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:53.631141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:53.631633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:53.632075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:53.632798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:53.633399 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:53.633698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:53.773804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:53.781998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8f078aaa-5073-4d61-894f-40ed330eace2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161926 Aug 29 23:08:53.782556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1631/3157] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:53 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:54.079318 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:54.081790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:54.088515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:54.088996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:54.089431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:54.090116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:54.090563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:54.090977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:54.223887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:54.232114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4fb87c7f-1886-4c57-9fb2-8792a7a3f333 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.158245 Aug 29 23:08:54.232763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1527/3158] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:54 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:54.805081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:54.805689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:54.812026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:54.812562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:54.812997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:54.813697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:54.814778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:54.815205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:54.959513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:54.968292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4e2c9032-86b2-4f0e-8d4f-c95cdf56c98a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.167265 Aug 29 23:08:54.968881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1632/3159] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:54 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:55.254136 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:55.254724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:55.261364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:55.261848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:55.262301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:55.262992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:55.263512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:55.263943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:55.408617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:55.417638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a0f46f97-b7b2-465e-a97d-98c8faac6edd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.167491 Aug 29 23:08:55.418238 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1528/3160] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:55 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:55.990714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:55.991367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:55.998432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:55.998922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:55.999393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:56.000095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:56.000592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:56.001018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:56.150177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:56.159996 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6525018e-82b7-405f-bd66-908fbdb16db7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.173459 Aug 29 23:08:56.160628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1633/3161] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:55 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:56.439847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:56.440846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:56.447554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:56.448041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:56.448509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:56.449209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:56.449666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:56.450092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:56.597394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:56.606208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6ae73f9d-8900-4979-b7bf-d77fa1c84e80 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170839 Aug 29 23:08:56.606806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1529/3162] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:56 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:57.182237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:57.182814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:57.190112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:57.190594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:57.191027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:57.191731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:57.192229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:57.192633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:57.357902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:57.367199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-17049df0-de6f-4339-b686-8a910d99ba7d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.189173 Aug 29 23:08:57.367793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1634/3163] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:57 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:57.628229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:57.628892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:57.635729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:57.636229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:57.636667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:57.637351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:57.637800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:57.638210 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:57.798269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:57.807481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-87311b0a-28e5-4a60-b4a6-4516ac2e9f0e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.183140 Aug 29 23:08:57.808213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1530/3164] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:57 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:58.389288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:58.389916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:58.398024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:58.398562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:58.399151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:58.399912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:58.400628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:58.401108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:58.544384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:58.553346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-296e7ada-aaa1-4a55-ac26-26e4f87538c5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.168489 Aug 29 23:08:58.554194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1635/3165] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:58 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:58.831218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:58.831858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:58.838885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:58.839385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:58.839830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:58.840613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:58.841072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:58.841501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:59.013153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:59.022534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8456fd5f-64a4-47ee-a3de-0a79035ea757 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.195998 Aug 29 23:08:59.026106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1531/3166] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:58 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:59.575514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:08:59.576117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:08:59.583913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:59.584437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:59.584877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:59.585579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:08:59.587032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:08:59.587032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:08:59.725368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:08:59.733727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-987c79df-d2a2-4415-9b5a-fdee5e970c50 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.162194 Aug 29 23:08:59.734313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1636/3167] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:08:59 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:00.043754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:00.044537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:00.052413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:00.052948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:00.053394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:00.054447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:00.054951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:00.055440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:00.204967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:00.213511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b2ce2aed-9aac-4f1a-b919-2a7d58869c3a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.173696 Aug 29 23:09:00.214088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1532/3168] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:00 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:00.756115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:00.756783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:00.763524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:00.764016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:00.764487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:00.765192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:00.765651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:00.766083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:00.905467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:00.914032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ccfd8ada-d314-4e1c-8a11-2ba5a62606ec tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.162311 Aug 29 23:09:00.914603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1637/3169] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:00 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:01.236800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:01.237637 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:01.245272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:01.245808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:01.246276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:01.247116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:01.247572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:01.248038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:01.401231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:01.410226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-451dff3e-ce3d-472c-9e77-1a22d1d77b32 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.178400 Aug 29 23:09:01.410825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1533/3170] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:01 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:01.935547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:01.936281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:01.943616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:01.944114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:01.944585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:01.945370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:01.945868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:01.946332 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:02.112948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:02.123601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1c3d4db8-7ace-4608-a26f-6c32a66ad6e3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.191976 Aug 29 23:09:02.124214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1638/3171] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:01 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:02.432989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:02.433666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:02.440983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:02.441598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:02.442105 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:02.442890 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:02.443427 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:02.443898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:02.603841 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:02.613936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-377a1f48-3628-45c9-be17-824d406890aa tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.185117 Aug 29 23:09:02.614530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1534/3172] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:02 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:03.146765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:03.147461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:03.154350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:03.154838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:03.155272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:03.155975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:03.156470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:03.156893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:03.306832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:03.315726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e489e49d-0290-4d0d-b861-ed7acebc1cc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.173555 Aug 29 23:09:03.316357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1639/3173] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:03 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:03.647386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:03.648023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:03.655135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:03.655622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:03.656055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:03.656872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:03.657388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:03.658804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:03.679409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:03.810605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:03.827490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d638fe57-14dd-4867-9536-fa80e747a267 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.183605 Aug 29 23:09:03.828673 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1535/3174] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:03 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:04.337790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:04.338395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:04.345480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:04.346098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:04.346807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:04.347709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:04.348209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:04.348679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:04.499014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:04.509499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1d40dd2f-8afe-4bae-8ad2-4dc5e0859a2c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.175672 Aug 29 23:09:04.510171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1640/3175] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:04 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:04.857251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:04.857928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:04.866301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:04.866790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:04.867221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:04.867947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:04.868432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:04.868859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:05.048662 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:05.058999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-57e4e2e4-bd53-42ed-b8c3-faae6495853e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.205757 Aug 29 23:09:05.059597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1536/3176] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:04 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:05.533624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:05.534544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:05.541921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:05.542409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:05.542854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:05.543709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:05.544565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:05.545128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:05.707462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:05.716240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-176dfae2-ce97-4ffa-b6d9-d9679453c6be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.187257 Aug 29 23:09:05.716842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1641/3177] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:05 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:06.084166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:06.084821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:06.091496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:06.091981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:06.092458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:06.093280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:06.093813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:06.094241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:06.259952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:06.269197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5ada09a2-bb98-4d85-ba47-136c169c5fa2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.189897 Aug 29 23:09:06.269790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1537/3178] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:06 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:06.739884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:06.740531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:06.747214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:06.747704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:06.748164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:06.748871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:06.749328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:06.749766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:06.896300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:06.899749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:06.904874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dd4f323d-7c29-403d-807f-addcc580304d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.169777 Aug 29 23:09:06.912182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1642/3179] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:06 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:07.290441 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:07.291029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:07.297660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:07.298163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:07.298598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:07.299268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:07.299711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:07.300128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:07.447912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:07.457478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7838e2a5-7139-43db-a694-e03549f92544 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.170780 Aug 29 23:09:07.458065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1538/3180] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:07 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:07.931848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:07.932658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:07.943074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:07.943632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:07.944278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:07.945077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:07.945566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:07.945991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:08.106618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:08.116346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b6e94e3f-e553-48d5-bf2d-b67f7aae4f16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.189518 Aug 29 23:09:08.116919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1643/3181] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:07 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:08.479545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:08.480178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:08.487393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:08.487864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:08.488324 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:08.489004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:08.489452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:08.489862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:08.623981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:08.633123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-003e63cb-60fc-460f-8d25-ba27b22e4d4c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.157371 Aug 29 23:09:08.633716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1539/3182] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:08 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:09.138149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:09.138765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:09.145631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:09.146113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:09.146557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:09.147240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:09.147689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:09.148106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:09.288465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:09.297438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8da2925b-872a-483a-b109-cf5cfa358f55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.162919 Aug 29 23:09:09.298410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1644/3183] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:09 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:09.655465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:09.656078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:09.662646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:09.663112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:09.663538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:09.664239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:09.664685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:09.665097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:09.793893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:09.802736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-71b7b5f1-a581-4a4f-8a19-73571efda0fd tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.151078 Aug 29 23:09:09.803602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1540/3184] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:09 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:10.319381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:10.319987 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:10.326842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:10.327329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:10.327770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:10.328513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:10.329600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:10.330078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:10.465113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:10.473953 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-74005ddf-5356-4bf6-9ff8-1e5a523ace07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158611 Aug 29 23:09:10.474596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1645/3185] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:10 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:10.824588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:10.825181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:10.834515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:10.834984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:10.835410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:10.836087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:10.836690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:10.837117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:10.976067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:10.984323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-41f4343e-ee1d-4920-a7c8-00c63739ec40 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163575 Aug 29 23:09:10.984900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1541/3186] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:10 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:11.495104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:11.495721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:11.503003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:11.503484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:11.503916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:11.504646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:11.505096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:11.505525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:11.640084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:11.648853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1734044a-05b4-4052-999a-80c26cf90c21 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157797 Aug 29 23:09:11.649435 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1646/3187] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:11 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:12.006530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:12.007171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:12.013898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:12.014395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:12.014828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:12.015512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:12.016005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:12.016474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:12.157667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:12.166203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-671bda4a-578e-4ce7-b5bd-fc79516ce99c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.163784 Aug 29 23:09:12.166773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1542/3188] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:12 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:12.669982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:12.670621 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:12.678418 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:12.678896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:12.679429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:12.680015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:12.680496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:12.680923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:12.819033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:12.827344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-33b2363f-82a6-48db-8c62-473927afdac4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161267 Aug 29 23:09:12.827912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1647/3189] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:12 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:13.187580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:13.188117 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:13.194596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:13.195065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:13.195494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:13.196216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:13.196664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:13.197078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:13.334395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:13.342948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4de5c6b8-a219-4768-9fd3-f0f332fa66ce tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.159284 Aug 29 23:09:13.343525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1543/3190] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:13 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:13.848521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:13.849125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:13.855501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:13.855975 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:13.856462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:13.857161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:13.857606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:13.858027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:13.995696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:14.004879 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8f96cd47-5dc8-45e4-b212-e68233236070 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160201 Aug 29 23:09:14.005452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1648/3191] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:13 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:14.366122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:14.366677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:14.373154 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:14.373626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:14.374064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:14.374745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:14.375199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:14.375618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:14.508930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:14.517770 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-778c4acb-d1da-4d12-b68d-41bed56eb49a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.156411 Aug 29 23:09:14.518384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1544/3192] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:14 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:15.027286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:15.028026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:15.035283 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:15.035869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:15.036433 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:15.037168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:15.037785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:15.038247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:15.176068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:15.184652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b2b1ba92-8800-4127-9d06-d1fc65ba4682 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161392 Aug 29 23:09:15.185230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1649/3193] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:15 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:15.539700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:15.540431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:15.546868 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:15.547336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:15.547759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:15.548462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:15.549279 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:15.549717 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:15.682044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:15.690415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-83711cc1-9f30-4fd1-b640-5d5fc3b5f437 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.154578 Aug 29 23:09:15.690981 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1545/3194] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:15 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:16.206671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:16.207264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:16.213855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:16.214355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:16.214799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:16.215499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:16.215949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:16.216408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:16.450972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:16.459481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8c70d722-8e59-4a9d-8cd9-ac578de85b5c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.256968 Aug 29 23:09:16.459977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1650/3195] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:16 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:16.711381 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:16.711937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:16.718666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:16.719143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:16.723297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:16.723297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:16.723297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:16.723297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:16.861112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:16.871789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4ad67058-9128-4dec-9945-1b2adae41c06 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.164153 Aug 29 23:09:16.872473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1546/3196] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:16 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:17.480970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:17.481610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:17.489058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:17.489543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:17.489980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:17.490681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:17.491128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:17.491553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:17.631492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:17.639789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d6b86d87-7690-4b2c-ac8b-033a71149c26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.162750 Aug 29 23:09:17.640381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1651/3197] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:17 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:17.901114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:17.902024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:17.908653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:17.909147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:17.909627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:17.911288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:17.912079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:17.912751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:18.083724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:18.093020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2bcd330f-6ca0-4931-8dcd-6119ffeef4ac tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 200 len: 1726 microversion: 2.1 time: 0.195726 Aug 29 23:09:18.093613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1547/3198] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:17 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:18.129690 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d474cd19-7055-45d6-9462-d88dc65b761e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '.version_select at 0x7febd522b8b0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:18.224626 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d474cd19-7055-45d6-9462-d88dc65b761e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571313605" status: 202 len: 0 microversion: 2.1 time: 0.113607 Aug 29 23:09:18.225471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1652/3199] 10.222.0.59 () {58 vars in 1218 bytes} [Mon Aug 29 23:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571313605 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:09:18.580731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:18.581259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:18.587752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:18.600267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:18.600267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:18.600267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:18.600267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:18.600724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:18.616030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:09:18.667999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:18.668743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:18.676726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:18.677239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:18.678211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:18.678918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:18.679408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:18.679906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:18.830365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:18.840829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b3a473f1-72e7-49dc-8b3c-3bc713065c97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.177916 Aug 29 23:09:18.841564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1653/3200] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:18 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:19.059443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac4f0301-9cc7-40a2-bc84-b5b6fb065afb tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "DELETE /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 204 len: 0 microversion: 2.20 time: 0.482297 Aug 29 23:09:19.060898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1548/3201] 10.222.0.59 () {60 vars in 1280 bytes} [Mon Aug 29 23:09:18 2022] DELETE /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 23:09:19.070395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:19.071146 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:19.078189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:19.078744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:19.079276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:19.080148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:19.080783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:19.081114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:19.223649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:19.232474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:19.234037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:19.235241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f1ef5aff-ccd9-4041-85ca-08465083bdbd tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1721 microversion: 2.20 time: 0.169821 Aug 29 23:09:19.236048 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1654/3202] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:09:19 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:09:19.845104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-800f2d86-233b-4ef6-beac-012c65320584 req-1150d2a9-8275-4b0c-b312-689ebdf0989b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50bc49c0-59c8-4adc-9c9a-a43adb38c922", "tag": "3230f74d-5d52-4d21-bcb2-a8da0c68daca"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:09:19.863133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:19.865025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:19.876793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:19.877703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:19.878902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:19.880122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:19.880824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:19.884822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:19.885099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-800f2d86-233b-4ef6-beac-012c65320584 req-1150d2a9-8275-4b0c-b312-689ebdf0989b service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:19.889664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-800f2d86-233b-4ef6-beac-012c65320584 req-1150d2a9-8275-4b0c-b312-689ebdf0989b service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:19.890080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-800f2d86-233b-4ef6-beac-012c65320584 req-1150d2a9-8275-4b0c-b312-689ebdf0989b service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:19.915863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-800f2d86-233b-4ef6-beac-012c65320584 req-1150d2a9-8275-4b0c-b312-689ebdf0989b service nova] Creating event network-changed:3230f74d-5d52-4d21-bcb2-a8da0c68daca for instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 on hv-cinder-85426 Aug 29 23:09:19.929915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-800f2d86-233b-4ef6-beac-012c65320584 req-1150d2a9-8275-4b0c-b312-689ebdf0989b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089254 Aug 29 23:09:19.930691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1549/3203] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:09:20.015234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-822cee42-3130-4415-a656-943d1c65c8d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: .version_select at 0x7febd51acee0>, body: {"keypair": {"name": "tempest-keypair-1016888996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXXn47oI7k15ZCx69H/oZ4/hIs0c6EU+OtahWLHTv+OpbCob2DVYGeLbO+PipKWVLi3feiqXSN+cMFUPd3OfEgVRDAUjLkWw/RgmywiUS/DxfjLPk4OvCZrtV9HPfUBeQ=="}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:09:20.034630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-822cee42-3130-4415-a656-943d1c65c8d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for project a826c462a3fa429eb866d354afcbe950. Resources: {'key_pairs'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:09:20.039831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-822cee42-3130-4415-a656-943d1c65c8d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for user 9c2fdfdb62b54f05b7d81f14ec197cca and project a826c462a3fa429eb866d354afcbe950. Resources: {'key_pairs'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:09:20.078925 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:20.079323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6aade8bd-4db0-4c90-aa81-af1d349b735b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.219923 Aug 29 23:09:20.079995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1655/3204] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:19 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:20.173101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-822cee42-3130-4415-a656-943d1c65c8d2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162086 Aug 29 23:09:20.174011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1550/3205] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 23:09:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:09:20.263558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:20.264203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:20.271963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:20.272823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:20.273967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:20.275199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:20.275910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:20.278017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:20.446282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:20.456238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:20.457602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:20.459008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-83981ad3-1cd0-4790-96d9-6590066d4e4b tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1721 microversion: 2.20 time: 0.200784 Aug 29 23:09:20.459576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1656/3206] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:09:20 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:09:21.108856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:21.109646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:21.120989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:21.122224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:21.122679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:21.123615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:21.123861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:21.124527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:21.284942 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:21.293644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-318d29f8-27a9-4d39-93f9-0097948c6f62 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.189020 Aug 29 23:09:21.294240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1551/3207] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:21 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:21.482087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:21.482737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:21.490043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:21.490547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:21.491023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:21.491758 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:21.492211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:21.492643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:21.703106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:21.712075 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:21.715105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:21.716329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d7e29c21-7d4b-4dcb-b698-f9dd90e80086 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1721 microversion: 2.20 time: 0.238356 Aug 29 23:09:21.716919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1657/3208] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:09:21 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:09:21.946724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-f3580239-1ccd-4ceb-8c87-34f9ae6d7215 req-4fd1e4c4-c651-45a2-9a99-4d3fd453a092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a903cf9-0a2d-4391-ad67-ae87403930d7", "name": "network-vif-deleted", "tag": "7f847326-2f84-445f-8fd3-98855eb599bf"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:09:21.961750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-f3580239-1ccd-4ceb-8c87-34f9ae6d7215 req-4fd1e4c4-c651-45a2-9a99-4d3fd453a092 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:21.962458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-f3580239-1ccd-4ceb-8c87-34f9ae6d7215 req-4fd1e4c4-c651-45a2-9a99-4d3fd453a092 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:21.963455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-f3580239-1ccd-4ceb-8c87-34f9ae6d7215 req-4fd1e4c4-c651-45a2-9a99-4d3fd453a092 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:21.980123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:21.982740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-f3580239-1ccd-4ceb-8c87-34f9ae6d7215 req-4fd1e4c4-c651-45a2-9a99-4d3fd453a092 service nova] Creating event network-vif-deleted:7f847326-2f84-445f-8fd3-98855eb599bf for instance 0a903cf9-0a2d-4391-ad67-ae87403930d7 on hv-cinder-85426 Aug 29 23:09:21.996153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-f3580239-1ccd-4ceb-8c87-34f9ae6d7215 req-4fd1e4c4-c651-45a2-9a99-4d3fd453a092 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054202 Aug 29 23:09:21.997310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1552/3209] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:09:22.026185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-db47f2cf-0599-4b89-a124-52e515f51647 req-55b68518-6e26-442c-b61c-b611a2c54e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f7280f-a6e7-4027-9944-e320745e284b", "name": "network-vif-deleted", "tag": "3471a251-7b66-4aee-856f-19413b4e8340"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:09:22.036682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-db47f2cf-0599-4b89-a124-52e515f51647 req-55b68518-6e26-442c-b61c-b611a2c54e6b service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:22.037562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-db47f2cf-0599-4b89-a124-52e515f51647 req-55b68518-6e26-442c-b61c-b611a2c54e6b service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:22.038223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-db47f2cf-0599-4b89-a124-52e515f51647 req-55b68518-6e26-442c-b61c-b611a2c54e6b service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:22.054591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-db47f2cf-0599-4b89-a124-52e515f51647 req-55b68518-6e26-442c-b61c-b611a2c54e6b service nova] Creating event network-vif-deleted:3471a251-7b66-4aee-856f-19413b4e8340 for instance 28f7280f-a6e7-4027-9944-e320745e284b on hv-cinder-85426 Aug 29 23:09:22.060507 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-db47f2cf-0599-4b89-a124-52e515f51647 req-55b68518-6e26-442c-b61c-b611a2c54e6b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038439 Aug 29 23:09:22.061415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1658/3210] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:09:22.317644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:22.318387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:22.326127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:22.326618 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:22.327054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:22.327754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:22.328255 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:22.328681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:22.567520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:22.577296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-152708e8-28c7-4d27-9009-b6334e03e0d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.264571 Aug 29 23:09:22.577874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1553/3211] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:22 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:22.742289 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:22.744515 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:22.748661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:22.750781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:22.752383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:22.752832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:22.753675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:22.754128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:22.754552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:22.789008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:22.789503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:22.789945 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:22.790400 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lazy-loading 'fault' on Instance uuid 28f7280f-a6e7-4027-9944-e320745e284b {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:09:22.839951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:22.846179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:22.848206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42a287a54c4040ac828ee221a3f2e8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f8dd557e14a6483ebe7e39d902641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:22.849381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e4f21684-94e7-4b18-8b50-97d30b7758b8 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 200 len: 1371 microversion: 2.20 time: 0.112680 Aug 29 23:09:22.850117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1659/3212] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:09:22 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:09:23.287227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1093600385", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02e67e56-1d54-4626-ac0f-73743cdc8b11"}], "security_groups": [{"name": "tempest-securitygroup--228679582"}], "key_name": "tempest-keypair-1016888996", "user_data": "}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:09:23.296780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:23.395607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.network.neutron [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] validate_networks() for [('02e67e56-1d54-4626-ac0f-73743cdc8b11', None, None, None, None, None)] {{(pid=128151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:09:23.599177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:23.599817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:23.606150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:23.606644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:23.607085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:23.607792 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:23.608350 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:23.608776 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:23.751223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:23.755218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:23.760842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0d87917d-08c1-4536-a48f-68ad50b6b4c9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.166258 Aug 29 23:09:23.761356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1660/3213] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:23 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:23.783759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Flavor limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:09:23.784256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Image limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:09:23.784808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Flavor pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:09:23.785221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Image pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:09:23.785634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:09:23.794582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:23.795060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:23.795603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:23.796371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:23.796823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:23.797250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:23.814570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for project a826c462a3fa429eb866d354afcbe950. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:09:23.819198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for user 9c2fdfdb62b54f05b7d81f14ec197cca and project a826c462a3fa429eb866d354afcbe950. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:09:23.830235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Going to run 1 instances... {{(pid=128151) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:09:23.833287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:09:23.873204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:23.875107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:23.881284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:23.881811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:23.882306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:23.883043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:23.883545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:23.884009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:23.898888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] HTTP exception thrown: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Request method failure captured: Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b HTTP/1.1 Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEposl7iWvuVxr5iRqmEYz9T2-nelP1ZyY41W0xpo910Wd7us3SyThpO_WRA--bUEex36LVRr5JFm1rUu1q4GZNtQ82R5ZYMn7IiehvUXlHHNhJyXvYGkpYIdkTzwH71z4IF3Htb5vLVA5l8YtjufKPF48puwEDG7qnYlyhlY3eOjM Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:09:23.900576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d45f8dd557e14a6483ebe7e39d902641", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 42a287a54c4040ac828ee221a3f2e8c7 Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:23.902519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '28f7280f-a6e7-4027-9944-e320745e284b'} Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:09:23.903717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:23.905620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:23.907153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Returning 404 to user: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:09:23.907153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-501f2c71-9306-4d2f-a23b-cb3b1d1c35e2 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 404 len: 111 microversion: 2.20 time: 0.033677 Aug 29 23:09:23.907153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1661/3214] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:09:23 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 23:09:23.911066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2ea98f1c-ea08-4c71-8ba9-4955deceef32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '.version_select at 0x7febd523ee50>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:23.998769 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7494de82-d9e8-4805-8cee-f17c4450bc9e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.716032 Aug 29 23:09:23.999408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1554/3215] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 23:09:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:09:24.010802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e2072434-75ab-440d-b047-2ca02c921581 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:24.011463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e2072434-75ab-440d-b047-2ca02c921581 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:24.032449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2ea98f1c-ea08-4c71-8ba9-4955deceef32 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604934531" status: 204 len: 0 microversion: 2.20 time: 0.125072 Aug 29 23:09:24.033225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1662/3216] 10.222.0.59 () {60 vars in 1259 bytes} [Mon Aug 29 23:09:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604934531 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 23:09:24.184889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e2072434-75ab-440d-b047-2ca02c921581 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:24.193197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e2072434-75ab-440d-b047-2ca02c921581 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1242 microversion: 2.1 time: 0.186211 Aug 29 23:09:24.206049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1555/3217] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:24 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1242 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:24.782990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:24.783597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:24.791497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:24.791993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:24.792551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:24.793171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:24.793635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:24.794066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:25.008303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:25.017762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a8d02f5e-d3d6-424c-8ca9-5af396561453 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.239216 Aug 29 23:09:25.018364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1663/3218] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:24 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:25.040072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:25.046308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:25.048065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:25.048584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:25.049028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:25.049749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:25.050328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:25.050797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:25.064219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] HTTP exception thrown: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Request method failure captured: Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: DELETE /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b HTTP/1.1 Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUEposl7iWvuVxr5iRqmEYz9T2-nelP1ZyY41W0xpo910Wd7us3SyThpO_WRA--bUEex36LVRr5JFm1rUu1q4GZNtQ82R5ZYMn7IiehvUXlHHNhJyXvYGkpYIdkTzwH71z4IF3Htb5vLVA5l8YtjufKPF48puwEDG7qnYlyhlY3eOjM Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:09:25.066003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d45f8dd557e14a6483ebe7e39d902641", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 42a287a54c4040ac828ee221a3f2e8c7 Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.068330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '28f7280f-a6e7-4027-9944-e320745e284b'} Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:09:25.069185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.070598 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.072087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Returning 404 to user: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:09:25.072087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a322f5c0-df3e-4208-a558-1904a5a901c9 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "DELETE /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 404 len: 111 microversion: 2.20 time: 0.031380 Aug 29 23:09:25.072087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1556/3219] 10.222.0.59 () {60 vars in 1280 bytes} [Mon Aug 29 23:09:25 2022] DELETE /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:09:25.077095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:25.083517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 28f7280f-a6e7-4027-9944-e320745e284b] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:25.084484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:25.084965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:25.085397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:25.086096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:25.086530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:25.086947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:25.101651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] HTTP exception thrown: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Request method failure captured: Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b HTTP/1.1 Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEposl7iWvuVxr5iRqmEYz9T2-nelP1ZyY41W0xpo910Wd7us3SyThpO_WRA--bUEex36LVRr5JFm1rUu1q4GZNtQ82R5ZYMn7IiehvUXlHHNhJyXvYGkpYIdkTzwH71z4IF3Htb5vLVA5l8YtjufKPF48puwEDG7qnYlyhlY3eOjM Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:09:25.103187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d45f8dd557e14a6483ebe7e39d902641", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 42a287a54c4040ac828ee221a3f2e8c7 Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.105127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '28f7280f-a6e7-4027-9944-e320745e284b'} Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:09:25.106430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. Aug 29 23:09:25.108190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:09:25.110023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Returning 404 to user: Instance 28f7280f-a6e7-4027-9944-e320745e284b could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:09:25.110023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-201b3030-dfae-4e74-a538-8834e6ec732c tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b" status: 404 len: 111 microversion: 2.20 time: 0.032122 Aug 29 23:09:25.110023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1664/3220] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:09:25 2022] GET /compute/v2.1/servers/28f7280f-a6e7-4027-9944-e320745e284b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:09:25.214192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:25.214916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:25.221035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:25.227082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:25.227082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:25.227082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:25.227082 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:25.227568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:25.288257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:25.295950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-799c4c43-c810-4bbb-be23-f0580ada094e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1246 microversion: 2.1 time: 0.085619 Aug 29 23:09:25.296550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1557/3221] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:25 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:26.039724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:26.040498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:26.047235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:26.047728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:26.048205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:26.048918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:26.049428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:26.051740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:26.193364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:26.201751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d194e35e-7bd5-4bae-81eb-f7897b28bb4d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.166245 Aug 29 23:09:26.202314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1665/3222] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:26 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:26.317885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:26.318497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:26.325208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:26.325704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:26.326139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:26.326834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:26.327364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:26.327861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:26.391501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:26.399847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f16b898a-9d5e-4969-92a5-895e21cc1288 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1294 microversion: 2.1 time: 0.086281 Aug 29 23:09:26.400456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1558/3223] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:26 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:27.223601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:27.224258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:27.230992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:27.231477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:27.231938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:27.232663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:27.233115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:27.233568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:27.421812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:27.422657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:27.429998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:27.430608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:27.431114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:27.431930 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:27.432549 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:27.432986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:27.439355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:27.448835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-65740cbd-0063-45d1-817d-629400f750c4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.229719 Aug 29 23:09:27.459672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1666/3224] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:27 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:27.501284 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:27.510119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e3c5d803-6646-491c-9908-39baa12f3882 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1300 microversion: 2.1 time: 0.092250 Aug 29 23:09:27.510698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1559/3225] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:27 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:28.471097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:28.472438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:28.479600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:28.480084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:28.480558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:28.481272 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:28.481736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:28.482184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:28.532570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:28.533224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:28.541158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:28.541647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:28.542095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:28.542792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:28.543249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:28.543677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:28.686191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:28.695039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1666e175-6629-4dd1-bda5-21db25354e75 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1367 microversion: 2.1 time: 0.166384 Aug 29 23:09:28.695628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1560/3226] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:28 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:28.714874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:28.724352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-63b34622-54b2-4d40-ba50-e00d760587c8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.257138 Aug 29 23:09:28.725004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1667/3227] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:28 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:28.849214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-fd147279-1c14-48f3-b8e2-6ed4c1cce1d7 req-49889559-e5d9-47e0-b6c5-a060e60f4428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be965c9f-ec9c-41e9-af0a-d950543f8d3e", "tag": "c8d15c01-e112-4626-b5b3-0070d0f3ad43"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:09:28.859987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fd147279-1c14-48f3-b8e2-6ed4c1cce1d7 req-49889559-e5d9-47e0-b6c5-a060e60f4428 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:28.860809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fd147279-1c14-48f3-b8e2-6ed4c1cce1d7 req-49889559-e5d9-47e0-b6c5-a060e60f4428 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:28.861245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-fd147279-1c14-48f3-b8e2-6ed4c1cce1d7 req-49889559-e5d9-47e0-b6c5-a060e60f4428 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:28.876301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-fd147279-1c14-48f3-b8e2-6ed4c1cce1d7 req-49889559-e5d9-47e0-b6c5-a060e60f4428 service nova] Creating event network-changed:c8d15c01-e112-4626-b5b3-0070d0f3ad43 for instance be965c9f-ec9c-41e9-af0a-d950543f8d3e on hv-cinder-85426 Aug 29 23:09:28.882463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-fd147279-1c14-48f3-b8e2-6ed4c1cce1d7 req-49889559-e5d9-47e0-b6c5-a060e60f4428 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038539 Aug 29 23:09:28.883088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1561/3228] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:09:29.717151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:29.717870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:29.725107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:29.725600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:29.726094 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:29.726797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:29.727254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:29.727676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:29.749384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:29.752667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:29.759207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:29.759999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:29.760772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:29.762017 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:29.762659 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:29.763085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:29.873133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:29.881869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2c6ddd3c-587b-49e0-be17-bb7092602143 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1367 microversion: 2.1 time: 0.168663 Aug 29 23:09:29.882589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1668/3229] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:29 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:29.928362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:29.937036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-474a7268-06a8-44ba-84ab-a49b72a14c07 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.194785 Aug 29 23:09:29.937617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1562/3230] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:29 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:30.903689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:30.904981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:30.913166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:30.914002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:30.915145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:30.916083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:30.916876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:30.917078 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:30.959551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:30.960218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:30.967165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:30.967661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:30.968099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:30.969576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:30.970044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:30.970477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:31.067582 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:31.078710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-499da754-e4ba-4d23-b829-0c71caca0046 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1367 microversion: 2.1 time: 0.178731 Aug 29 23:09:31.088636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1669/3231] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:30 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:31.132664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:31.141319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-63ae947f-9428-4aed-8a17-ad4c3ed534e2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.186260 Aug 29 23:09:31.141972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1563/3232] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:30 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:32.099116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:32.099719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:32.106118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:32.106593 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:32.107020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:32.107695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:32.108161 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:32.108591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:32.163308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:32.163919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:32.170479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:32.171034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:32.171390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:32.172074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:32.172554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:32.172969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:32.255537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:32.263972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-998bcab7-9b2e-49c4-b517-f2a9ced25cfb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1367 microversion: 2.1 time: 0.168891 Aug 29 23:09:32.264894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1670/3233] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:32 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:32.314431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:32.324056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a7a0f4f6-4958-423e-ac21-4327fd9a2a65 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164855 Aug 29 23:09:32.324675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1564/3234] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:32 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:33.284862 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:33.285474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:33.292002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:33.292517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:33.292957 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:33.293753 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:33.294209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:33.294632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:33.345726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:33.346447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:33.353904 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:33.354472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:33.354971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:33.355728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:33.356287 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:33.356816 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:33.432711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:33.440396 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4a3a6253-b166-4eca-a8e1-a7ec006af564 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1367 microversion: 2.1 time: 0.159460 Aug 29 23:09:33.440971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1671/3235] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:33 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:33.491792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:33.499931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8d9cb246-b5bc-4ab9-83de-484222fba673 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158208 Aug 29 23:09:33.500528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1565/3236] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:33 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:34.175567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-10426094-2e25-4fc0-867f-efde3d5aec1b req-3510f34e-4328-45c6-b7a9-217fca491630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be965c9f-ec9c-41e9-af0a-d950543f8d3e", "name": "network-vif-plugged", "status": "completed", "tag": "c8d15c01-e112-4626-b5b3-0070d0f3ad43"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:09:34.185486 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-10426094-2e25-4fc0-867f-efde3d5aec1b req-3510f34e-4328-45c6-b7a9-217fca491630 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:34.186004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-10426094-2e25-4fc0-867f-efde3d5aec1b req-3510f34e-4328-45c6-b7a9-217fca491630 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:34.186424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-10426094-2e25-4fc0-867f-efde3d5aec1b req-3510f34e-4328-45c6-b7a9-217fca491630 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:34.197516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-10426094-2e25-4fc0-867f-efde3d5aec1b req-3510f34e-4328-45c6-b7a9-217fca491630 service nova] Creating event network-vif-plugged:c8d15c01-e112-4626-b5b3-0070d0f3ad43 for instance be965c9f-ec9c-41e9-af0a-d950543f8d3e on hv-cinder-85426 Aug 29 23:09:34.202404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-10426094-2e25-4fc0-867f-efde3d5aec1b req-3510f34e-4328-45c6-b7a9-217fca491630 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030477 Aug 29 23:09:34.202990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1672/3237] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:09:34.462558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:34.463168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:34.465087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:34.465791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=12 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:34.470953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:34.471455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:34.471863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:34.472586 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:34.473011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:34.473424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:34.523417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:34.524404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:34.532638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:34.533127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:34.533587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:34.534327 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:34.534785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:34.535209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:34.610461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:34.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b861d352-a497-4384-9432-cf5c6dbb034b tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1367 microversion: 2.1 time: 0.160843 Aug 29 23:09:34.619295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1566/3238] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:34 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:34.695316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:34.703449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-098cd943-303e-417a-b676-bcd5b9824d66 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.185618 Aug 29 23:09:34.706639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1673/3239] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:34 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:35.640448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:35.641055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:35.650519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:35.650996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:35.651423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:35.652100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:35.652572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:35.652996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:35.727546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:35.728166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:35.731086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:09:35.731243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:09:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d (ip 10.222.0.59) !!! Aug 29 23:09:35.743148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:35.743633 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:35.744069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:35.744825 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:35.745280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:35.745702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:35.794127 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:35.802763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dd296446-c488-4f9e-b3e5-494933154c8a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1367 microversion: 2.1 time: 0.165990 Aug 29 23:09:35.803352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1567/3240] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:35 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:35.881937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:35.890282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-079d92aa-e7a3-42ba-b907-a90a07eff48d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.167506 Aug 29 23:09:35.890923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1674/3241] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:35 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:36.823493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:36.824096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:36.831061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:36.831548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:36.831983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:36.832712 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:36.833166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:36.833601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:36.912844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:36.913450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:36.920366 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:36.921286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:36.921286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:36.921991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:36.922524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:36.922870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:36.981197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:36.993285 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-655942a9-3a2a-4bab-a2eb-9667d5f80c25 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1556 microversion: 2.1 time: 0.173475 Aug 29 23:09:36.993889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1568/3242] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:36 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:37.014440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac742c69-40a9-4e16-9e2a-8f511c894eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:37.014943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ac742c69-40a9-4e16-9e2a-8f511c894eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:37.021640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac742c69-40a9-4e16-9e2a-8f511c894eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:37.022145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac742c69-40a9-4e16-9e2a-8f511c894eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:37.022587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac742c69-40a9-4e16-9e2a-8f511c894eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:37.023295 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac742c69-40a9-4e16-9e2a-8f511c894eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:37.023754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac742c69-40a9-4e16-9e2a-8f511c894eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:37.024207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ac742c69-40a9-4e16-9e2a-8f511c894eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:37.070265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:37.079069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c7667fe3-1228-46c1-8742-be442d9bc9be tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.170772 Aug 29 23:09:37.079920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1675/3243] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:36 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:37.107091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac742c69-40a9-4e16-9e2a-8f511c894eb4 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096819 Aug 29 23:09:37.107690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1569/3244] 10.222.0.59 () {58 vars in 1275 bytes} [Mon Aug 29 23:09:37 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:09:38.101392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:38.102009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:38.108368 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:38.108901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:38.109279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:38.109988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:38.110516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:38.110908 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:38.326475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:38.334761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dbb1d17e-bfd5-4c7c-b654-d5352953a63a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.237401 Aug 29 23:09:38.335375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1676/3245] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:38 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:38.502944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-cd63d6ef-4b92-4216-ab23-3e08b6d5d7b3 req-a16e6ae2-cedb-4599-b0be-efa0580e70b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be965c9f-ec9c-41e9-af0a-d950543f8d3e", "tag": "c8d15c01-e112-4626-b5b3-0070d0f3ad43"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:09:38.512713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-cd63d6ef-4b92-4216-ab23-3e08b6d5d7b3 req-a16e6ae2-cedb-4599-b0be-efa0580e70b5 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:38.513243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-cd63d6ef-4b92-4216-ab23-3e08b6d5d7b3 req-a16e6ae2-cedb-4599-b0be-efa0580e70b5 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:38.513648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-cd63d6ef-4b92-4216-ab23-3e08b6d5d7b3 req-a16e6ae2-cedb-4599-b0be-efa0580e70b5 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:38.525980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-cd63d6ef-4b92-4216-ab23-3e08b6d5d7b3 req-a16e6ae2-cedb-4599-b0be-efa0580e70b5 service nova] Creating event network-changed:c8d15c01-e112-4626-b5b3-0070d0f3ad43 for instance be965c9f-ec9c-41e9-af0a-d950543f8d3e on hv-cinder-85426 Aug 29 23:09:38.531605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-cd63d6ef-4b92-4216-ab23-3e08b6d5d7b3 req-a16e6ae2-cedb-4599-b0be-efa0580e70b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032713 Aug 29 23:09:38.532794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1570/3246] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:09:39.356635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:39.357861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:39.364741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:39.365273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:39.365845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:39.366416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:39.366973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:39.367408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:39.505287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:39.514142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-22b0cfd4-d99a-4b82-b578-dbf42b78da5e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161412 Aug 29 23:09:39.514734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1677/3247] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:39 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:40.536277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:40.537721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:40.544406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:40.544898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:40.545366 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:40.546100 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:40.546553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:40.546975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:40.683777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:40.694334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f8594ba1-655b-4890-b27c-210f0d2de1e1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.162608 Aug 29 23:09:40.694941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1571/3248] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:40 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:41.716044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:41.716693 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:41.723600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:41.724086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:41.724719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:41.725815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:41.726277 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:41.726705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:41.865288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:41.873745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d62a2bc6-1daf-4f98-a1f1-db7112559193 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161479 Aug 29 23:09:41.874287 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1678/3249] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:41 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:42.895447 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:42.896045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:42.903165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:42.903692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:42.904128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:42.904863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:42.905316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:42.905738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:43.042029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:43.051093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d8bdc7e6-34cc-4c11-aece-36b2d1bc2d97 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159498 Aug 29 23:09:43.051684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1572/3250] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:42 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:44.072266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:44.072883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:44.079323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:44.079803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:44.080267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:44.080954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:44.081407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:44.081830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:44.211110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:44.219301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-041a5c92-c61c-4cd6-9763-87db4c35828e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151418 Aug 29 23:09:44.219875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1679/3251] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:44 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:45.240630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:45.241231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:45.248057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:45.248568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:45.249003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:45.249718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:45.250174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:45.250599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:45.269501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:45.380095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:45.389239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eea1a548-c8d6-460f-8fc2-9159043dd73c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152680 Aug 29 23:09:45.389831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1573/3252] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:45 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:46.411046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:46.411713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:46.418200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:46.418686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:46.419115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:46.419800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:46.420279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:46.420697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:46.439341 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:46.551118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:46.560429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ef4dd981-4ba6-4fa8-a1bd-68373b56838f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153217 Aug 29 23:09:46.561052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1680/3253] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:46 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:47.582201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:47.582737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:47.589912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:47.590390 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:47.590819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:47.591496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:47.591947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:47.592401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:47.726446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:47.734691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e8194524-c4d1-4b58-a62b-44021eee4626 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156558 Aug 29 23:09:47.735275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1574/3254] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:47 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:48.755756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:48.756423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:48.763612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:48.764099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:48.764567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:48.765259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:48.765716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:48.766144 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:48.896760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:48.906091 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e1e04bfe-716b-4aa2-8b2d-408fa29f8530 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154271 Aug 29 23:09:48.906665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1681/3255] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:48 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:49.927383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:49.927994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:49.934759 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:49.935236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:49.935666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:49.936393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:49.936842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:49.938336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:50.068516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:50.077011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5183131b-e565-4650-b127-3ecada00c9af tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153962 Aug 29 23:09:50.077588 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1575/3256] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:49 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:51.098883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:51.099536 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:51.106755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:51.107237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:51.107683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:51.108415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:51.108873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:51.109303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:51.242607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:51.251235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b6c8dc91-081a-47ee-8ded-2b7491b1ca15 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156305 Aug 29 23:09:51.251797 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1682/3257] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:51 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:52.272232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:52.273078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:52.279006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:52.279483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:52.279914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:52.280624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:52.281075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:52.281488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:52.414655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:52.422949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-34f1c3fa-5a19-44ea-84f4-1bc2c797321c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154750 Aug 29 23:09:52.423524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1576/3258] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:52 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:53.444614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:53.445243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:53.451619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:53.452093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:53.452654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:53.453381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:53.453931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:53.454269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:53.590489 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:53.598976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-73f09326-1606-4b10-a5c9-be438ee65da6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158788 Aug 29 23:09:53.599539 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1683/3259] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:53 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:54.620243 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:54.620889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:54.623249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:54.627949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:54.628492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:54.638715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:54.638715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:54.638715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:54.638715 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:54.759837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:54.768076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2a1a0484-1b59-42c0-808a-4c5ce7c7df06 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151987 Aug 29 23:09:54.768682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1577/3260] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:54 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:55.790022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:55.790671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:55.792548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:55.797235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:55.797717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:55.798165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:55.798834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:55.799286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:55.799721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:55.930821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:55.939105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a02cbf75-b641-4bd8-a240-201708db8aa9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153382 Aug 29 23:09:55.939678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1684/3261] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:55 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:56.960368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:56.960917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:56.967465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:56.967940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:56.968405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:56.969096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:56.969550 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:56.969974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:57.098093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:57.107068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-796cbbc8-0ab7-40d5-8772-bfeab56ab9d5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150720 Aug 29 23:09:57.107640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1578/3262] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:56 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:58.129043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:58.129644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:58.136151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:58.136645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:58.137080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:58.137763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:58.138215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:58.138640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:58.271728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:58.280535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b9f9f001-3173-492d-b4f3-37d0f12af591 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155296 Aug 29 23:09:58.281108 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1685/3263] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:58 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:59.302701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:09:59.303294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:09:59.309734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:59.310204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:59.310630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:59.311306 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:09:59.311748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:09:59.312186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:09:59.447066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:09:59.455278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8a64847c-268c-44f9-a3bd-ac0a61c8626c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156741 Aug 29 23:09:59.455857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1579/3264] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:09:59 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:00.477325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:00.477958 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:00.484619 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:00.485106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:00.485550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:00.486248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:00.486707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:00.487136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:00.622880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:00.632056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-502aa6b4-c23c-4d89-ad24-1cfaa0a4f40d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158692 Aug 29 23:10:00.633267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1686/3265] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:00 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:01.654198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:01.654801 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:01.661445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:01.661937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:01.662372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:01.663060 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:01.664096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:01.664760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:01.793785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:01.802185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-877ff3ae-8070-4a35-a040-4c2aff2561b5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151871 Aug 29 23:10:01.802747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1580/3266] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:01 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:02.823965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:02.824529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:02.831016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:02.831508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:02.831970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:02.832713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:02.833174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:02.833601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:02.965005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:02.973387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-68bad031-3456-482c-8fab-89f407a6fa0f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154057 Aug 29 23:10:02.973955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1687/3267] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:02 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:10:03.995111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:03.995873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:04.002218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:04.002697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:04.003125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:04.003805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:04.004290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:04.004709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:04.142438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:04.150749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-73690d2e-fc78-4138-b8c7-ad6a5b68ac90 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159851 Aug 29 23:10:04.151322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1581/3268] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:03 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:05.172413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:05.173262 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:05.180518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:05.181000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:05.181465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:05.182184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:05.183309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:05.183755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:05.315214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:05.324030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-763fc87e-25a6-46be-9242-11e0c6b576d3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155269 Aug 29 23:10:05.324683 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1688/3269] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:05 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:06.345913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:06.346486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:06.354181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:06.355348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:06.356044 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:06.356907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:06.357263 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:06.357685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:06.504695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:06.513012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d1c7188d-e58e-46b9-a02a-a5504d4fe9f3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.171142 Aug 29 23:10:06.513594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1582/3270] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:06 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:07.534017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:07.534638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:07.541119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:07.541592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:07.542027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:07.543189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:07.543638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:07.544052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:07.676831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:07.685756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5469e21d-0f9e-4a79-972b-1aa9810f05f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155631 Aug 29 23:10:07.686324 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1689/3271] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:07 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:08.707180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:08.707784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:08.714472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:08.714949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:08.715382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:08.716477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:08.716950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:08.717376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:08.851990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:08.861362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-69b78276-b6c0-453b-a459-4333d5a30a48 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157882 Aug 29 23:10:08.861941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1583/3272] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:08 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:09.882835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:09.883441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:09.890373 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:09.890853 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:09.891284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:09.891967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:09.892450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:09.892878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:10.027537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:10.036106 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bb78abb7-3341-4dac-846c-b9c46d89f0f2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157068 Aug 29 23:10:10.036721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1690/3273] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:09 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:11.057406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:11.058016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:11.064806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:11.065283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:11.065709 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:11.066384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:11.066828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:11.067246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:11.200187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:11.208689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3f08258b-8fd9-4d45-889c-f6a558894a56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155207 Aug 29 23:10:11.209258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1584/3274] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:11 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:12.229827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:12.230415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:12.237547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:12.238395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:12.238521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:12.239107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:12.239558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:12.239971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:12.368713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:12.377250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6fef70b5-3fad-4230-ba6c-9c37d7120b02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151343 Aug 29 23:10:12.377846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1691/3275] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:12 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:13.398599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:13.399204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:13.406554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:13.407046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:13.407485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:13.408241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:13.408700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:13.409178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:13.541150 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:13.549946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-22ef507b-4243-4ca9-b38a-b0b429e58569 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154734 Aug 29 23:10:13.550538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1585/3276] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:13 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:14.571398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:14.572030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:14.578544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:14.579022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:14.579456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:14.580150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:14.581343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:14.581783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:14.710385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:14.711171 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-60d9c518-6ae4-469b-9610-b9ee5602d558 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:14.711680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-60d9c518-6ae4-469b-9610-b9ee5602d558 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:14.718029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60d9c518-6ae4-469b-9610-b9ee5602d558 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:14.718505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60d9c518-6ae4-469b-9610-b9ee5602d558 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:14.718936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60d9c518-6ae4-469b-9610-b9ee5602d558 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:14.719067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f38d509e-54e6-4560-bd4a-5a375526084d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151381 Aug 29 23:10:14.719537 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1692/3277] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:14 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:14.719672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60d9c518-6ae4-469b-9610-b9ee5602d558 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:14.720046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60d9c518-6ae4-469b-9610-b9ee5602d558 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:14.720501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-60d9c518-6ae4-469b-9610-b9ee5602d558 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:14.744041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-60d9c518-6ae4-469b-9610-b9ee5602d558 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e/ips" status: 200 len: 149 microversion: 2.1 time: 0.036661 Aug 29 23:10:14.744587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1586/3278] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 23:10:14 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:10:15.740102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:15.741462 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:15.748590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:15.749096 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:15.749532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:15.750223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:15.750678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:15.751100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:15.887229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:15.896298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-faa40b76-0dca-4f3c-b7cb-eabcd7576d1d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160154 Aug 29 23:10:15.898500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1693/3279] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:15 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:16.917730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:16.918297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:16.925005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:16.925495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:16.926187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:16.926884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:16.927363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:16.927789 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:16.930540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=79 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:17.061122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:17.069332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f5abebfd-9ecf-4d25-be87-55cdc46060f5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155709 Aug 29 23:10:17.069898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1587/3280] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:16 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:18.091047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:18.091656 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:18.098805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:18.099284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:18.099721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:18.100431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:18.100884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:18.101304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:18.103882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=81 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:18.233151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:18.242270 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b5a6d413-ed08-48b8-8224-bae93cd1b6d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155091 Aug 29 23:10:18.242837 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1694/3281] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:18 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:19.263601 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:19.264214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:19.270889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:19.271368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:19.271803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:19.272645 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:19.273095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:19.273518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:19.402883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:19.411292 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-26781093-9cc7-401a-b19b-6dd7e38a09b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151450 Aug 29 23:10:19.411857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1588/3282] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:19 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:20.433159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:20.433763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:20.440280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:20.440766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:20.441213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:20.441948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:20.442564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:20.442995 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:20.577290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:20.585602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-972bb57a-1dce-4d53-bae2-4dedb4100a5f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156245 Aug 29 23:10:20.586227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1695/3283] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:20 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:21.606807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:21.607420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:21.613913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:21.614386 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:21.614805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:21.615483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:21.615996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:21.616365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:21.751310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:21.760496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f7c96095-7957-4288-b98c-d51de5ad95ab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157412 Aug 29 23:10:21.761080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1589/3284] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:21 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:22.782280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:22.782883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:22.790381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:22.790858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:22.791455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:22.792155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:22.792613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:22.793032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:22.920386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:22.929196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5da4bf4a-39f0-4d39-a25a-818cfaa52586 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150759 Aug 29 23:10:22.929777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1696/3285] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:22 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:23.950456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:23.951065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:23.957660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:23.958135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:23.958591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:23.959270 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:23.959719 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:23.960154 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:24.091158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:24.100097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2466b8ae-75aa-4639-945c-07638328ac8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153672 Aug 29 23:10:24.102294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1590/3286] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:23 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:25.122151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:25.122761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:25.128759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:25.129237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:25.129679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:25.131002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:25.131458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:25.131887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:25.263924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:25.272195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cc341492-fdf0-446e-a76b-40cbb30c4432 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154058 Aug 29 23:10:25.272762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1697/3287] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:25 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:26.293724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:26.294340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:26.296640 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=28 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:26.301652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:26.302882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:26.303322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:26.307084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:26.307084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:26.307084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:26.436033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:26.444737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cf37ee41-1531-4ad5-b88b-2f80456bbb1b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154955 Aug 29 23:10:26.445416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1591/3288] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:26 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:27.465695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:27.466252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:27.468803 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=28 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:27.473610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:27.479413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:27.479413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:27.479413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:27.479413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:27.479954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:27.606526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:27.615632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-326a8730-8210-4212-89e6-156911b8daa3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153322 Aug 29 23:10:27.616297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1698/3289] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:27 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:28.637123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:28.637758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:28.644110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:28.644614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:28.645040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:28.645722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:28.646169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:28.647242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:28.781887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:28.790070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b60e3ff5-5d79-44e1-acf6-d83fcfe42997 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156932 Aug 29 23:10:28.790633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1592/3290] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:28 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:10:29.811750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:29.812414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:29.818814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:29.819288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:29.819715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:29.820424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:29.820878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:29.821295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:29.954565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:29.963423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f98c9bfc-27ea-4e2c-ae5c-26bd90de641b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155694 Aug 29 23:10:29.963993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1699/3291] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:29 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:30.984572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:30.985126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:30.992431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:30.992947 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:30.993374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:30.994050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:30.994501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:30.994917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:31.123383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:31.132235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-94d7cb21-0681-4676-8187-280f40b0b883 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151579 Aug 29 23:10:31.139667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1593/3292] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:30 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:32.152956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:32.153563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:32.159936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:32.160444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:32.160875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:32.161548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:32.161998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:32.162410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:32.293001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:32.301447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8a811c11-9bb4-4a8b-93c4-ca9a1d980823 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152408 Aug 29 23:10:32.302008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1700/3293] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:32 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:33.323141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:33.324393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:33.330829 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:33.331303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:33.331731 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:33.332471 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:33.332917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:33.333333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:33.464072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:33.472256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3f9a49b8-7e0d-472c-a505-2febd6bf7388 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152956 Aug 29 23:10:33.472823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1594/3294] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:33 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:34.493402 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:34.494013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:34.500528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:34.501010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:34.501446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:34.502135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:34.502630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:34.503055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:34.634783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:34.641271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7dd2b561-56e7-43da-bcde-3f4a19faf957 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152006 Aug 29 23:10:34.641830 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1701/3295] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:34 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:35.663253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:35.663998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:35.671065 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:35.671590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:35.672023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:35.672745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:35.673194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:35.673617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:35.802074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:35.810994 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c305ab77-a83d-4002-9cb0-f57211a9fcc8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151721 Aug 29 23:10:35.811569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1595/3296] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:35 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:36.833165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:36.833815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:36.841182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:36.841674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:36.842113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:36.842855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:36.843334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:36.843768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:36.979936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:36.988155 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b0360536-91b4-45c3-8ad9-a0b72d98f64f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159253 Aug 29 23:10:36.988741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1702/3297] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:36 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:10:38.009246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:38.009857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:38.016321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:38.016814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:38.017249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:38.018030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:38.018481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:38.018907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:38.149744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:38.157929 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6fc811eb-e317-41bd-807b-3796802d776b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152809 Aug 29 23:10:38.158497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1596/3298] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:38 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:39.182361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:39.182980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:39.189635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:39.190116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:39.190587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:39.191281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:39.191737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:39.192189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:39.324979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:39.333391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-edaf07c4-4b72-4ad9-b27f-0a55589e33aa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155888 Aug 29 23:10:39.334003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1703/3299] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:39 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:40.355726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:40.356347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:40.362819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:40.363297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:40.363763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:40.364492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:40.364952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:40.365375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:40.494737 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:40.502809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-432c2e79-2084-4190-bbe6-9282d921f46c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151821 Aug 29 23:10:40.503368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1597/3300] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:40 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:41.525225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:41.525910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:41.532267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:41.532747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:41.533174 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:41.533855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:41.534301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:41.534718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:41.668406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:41.677260 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-14c3f1ba-3f50-494f-965c-a3f06e94aa16 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156370 Aug 29 23:10:41.677823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1704/3301] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:41 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:42.698240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:42.698842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:42.705315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:42.705793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:42.706220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:42.706905 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:42.707349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:42.707765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:42.837352 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:42.845608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-84647662-5ee4-4439-8f91-e17db2a3ac02 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151383 Aug 29 23:10:42.846174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1598/3302] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:42 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:43.866505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:43.867081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:43.874331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:43.874818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:43.875247 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:43.875934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:43.876416 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:43.876838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:44.010409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:44.018816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-80433d47-d1ae-4b0a-80c3-836b5e6771a6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156254 Aug 29 23:10:44.019374 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1705/3303] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:43 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:45.039779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:45.040975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:45.047304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:45.047783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:45.048237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:45.048920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:45.049365 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:45.049783 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:45.185432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:45.193956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4d6b3052-a970-48f5-b200-392287b677d9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158131 Aug 29 23:10:45.194531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1599/3304] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:45 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:46.214956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:46.215513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:46.222045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:46.222526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:46.222954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:46.223632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:46.224079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:46.224526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:46.354748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:46.362818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8e20a147-67c5-4e5c-9b6e-309e12b2c11c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151904 Aug 29 23:10:46.363410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1706/3305] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:46 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:47.385224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:47.385976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:47.392632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:47.393107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:47.393536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:47.394221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:47.394663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:47.395074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:47.397725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=78 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:47.524188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:47.532437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0ac67465-fb34-40a2-9690-4fe3fc1f0991 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151600 Aug 29 23:10:47.533003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1600/3306] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:47 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:48.553928 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:48.554517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:48.561450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:48.561929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:48.562468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:48.563150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:48.563600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:48.564018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:48.566578 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=78 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:48.698742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:48.707065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7789f38b-6960-4ea4-87c1-5e8bbd7e2a80 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157533 Aug 29 23:10:48.708028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1707/3307] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:48 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:49.728507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:49.729106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:49.736260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:49.736749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:49.737183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:49.737871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:49.738322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:49.738751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:49.869439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:49.877910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3d8378c5-bd0f-4d44-bc7f-97fc17567877 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153251 Aug 29 23:10:49.878488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1601/3308] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:49 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:50.899141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:50.899745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:50.906234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:50.906709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:50.907135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:50.907810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:50.908285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:50.908702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:51.035932 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:51.045119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3602a166-e185-4f60-853c-89b114f2ac70 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.149839 Aug 29 23:10:51.045731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1708/3309] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:50 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:52.066379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:52.067013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:52.073667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:52.075021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:52.075468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:52.076311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:52.076888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:52.077188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:52.207876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:52.217006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2b1e14ba-d52f-4718-9cb5-1bbc95d2b295 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154716 Aug 29 23:10:52.217814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1602/3310] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:52 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:53.238514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:53.239142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:53.245791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:53.246857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:53.247687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:53.248414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:53.248868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:53.249290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:53.383516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:53.392018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d503b6b7-ee9c-4d4a-8c73-68bf4f55afab tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157405 Aug 29 23:10:53.392645 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1709/3311] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:53 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:54.413664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:54.414311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:54.421334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:54.421819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:54.422254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:54.422944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:54.423397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:54.423819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:54.554278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:54.563297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b8537abe-8cab-4c9a-8091-6950663ef8ba tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153477 Aug 29 23:10:54.563864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1603/3312] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:54 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:55.584098 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:55.584754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:55.590754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:55.591279 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:55.592299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:55.592990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:55.593447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:55.593874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:55.720660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:55.729187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-81dce28d-5fc3-4b71-a36f-62e3beb1f039 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.149045 Aug 29 23:10:55.729918 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1710/3313] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:55 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:56.750902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:56.751509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:56.753837 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=26 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:56.758563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:56.764797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:56.764797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:56.764797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:56.764797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:56.765240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:56.892325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:56.900474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-80885254-fb84-4f0b-831c-068cfe591771 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153532 Aug 29 23:10:56.901036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1604/3314] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:56 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:57.923055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:57.923673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:57.926442 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=26 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:57.931152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:57.931636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:57.932073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:57.932794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:57.933257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:57.933681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:58.068497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:58.076940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-188671d0-96fb-4424-a153-458571aafa8a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158475 Aug 29 23:10:58.077510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1711/3315] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:57 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:10:59.098461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:10:59.099125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:10:59.105624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:59.106143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:59.106582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:59.107273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:10:59.107738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:10:59.108245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:10:59.236197 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:10:59.244346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-36b34199-c239-465a-b578-262d59688895 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.149767 Aug 29 23:10:59.251413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1605/3316] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:10:59 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:00.266700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:00.267258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:00.273647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:00.274122 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:00.274555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:00.275225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:00.275671 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:00.276087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:00.405553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:00.413935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-488db755-8f34-4193-bade-59ae1e05b2bd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151577 Aug 29 23:11:00.414499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1712/3317] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:00 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:01.437031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:01.437636 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:01.444181 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:01.444669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:01.445112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:01.445798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:01.446249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:01.446670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:01.827832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:01.835948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ba9c7c54-88ef-4c12-bcfb-80ea2d680815 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.402904 Aug 29 23:11:01.836560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1606/3318] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:01 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:02.857567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:02.858179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:02.865558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:02.866073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:02.866527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:02.867224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:02.867703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:02.868153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:02.997714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:03.006067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a83547d1-1123-46a4-bba8-0c2b824ec241 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152325 Aug 29 23:11:03.006647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1713/3319] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:02 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:04.029444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:04.030051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:04.036669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:04.037143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:04.037572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:04.038258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:04.038704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:04.039123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:04.166004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:04.175113 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-84105f89-409b-41e7-bcc2-7efd54e90954 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.149494 Aug 29 23:11:04.175624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1607/3320] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:04 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:05.196597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:05.197241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:05.204378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:05.204935 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:05.205306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:05.205993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:05.206451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:05.206910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:05.340756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:05.348970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-49e7975c-25e6-43d9-bbde-71a78cea0703 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156189 Aug 29 23:11:05.349533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1714/3321] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:05 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:06.369991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:06.370614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:06.377398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:06.377875 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:06.378312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:06.379033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:06.379479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:06.379895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:06.514242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:06.522979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-448f52ce-281c-4ecb-b2e5-6f807d4d82bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156942 Aug 29 23:11:06.523548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1608/3322] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:06 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:07.544892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:07.545454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:07.553039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:07.553521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:07.554168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:07.554679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:07.555133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:07.555552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:07.688190 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:07.696570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c9716633-12bb-4da0-afc1-6b1f1e53cdee tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155585 Aug 29 23:11:07.697137 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1715/3323] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:07 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:08.716767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:08.717399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:08.723983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:08.724558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:08.725000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:08.725708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:08.726143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:08.726564 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:08.859075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:08.868320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5a096b5f-9042-4128-87c5-4913962fe4b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155394 Aug 29 23:11:08.868901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1609/3324] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:08 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:09.889110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:09.889749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:09.896815 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:09.897296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:09.897751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:09.898421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:09.898876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:09.899329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:10.036055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:10.044778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b2a493aa-4575-4fe8-be97-2504187a8989 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159489 Aug 29 23:11:10.049421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1716/3325] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:09 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:11.067633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:11.068182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:11.074592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:11.075075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:11.075501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:11.076209 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:11.076660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:11.077081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:11.209941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:11.218128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-26198afb-4e67-4368-9682-2cf319463956 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155141 Aug 29 23:11:11.218699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1610/3326] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:11 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:12.240518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:12.241074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:12.248555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:12.249076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:12.249519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:12.250288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:12.250750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:12.251178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:12.383102 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:12.391447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-74812158-ca0b-4e7f-afd5-7bdd1857bf5b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155340 Aug 29 23:11:12.392030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1717/3327] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:12 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:13.412963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:13.413604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:13.421192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:13.421680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:13.422111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:13.423506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:13.423506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:13.423751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:13.552634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:13.560879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dd8eb38a-c4fb-4966-a0cf-fe3d69a8836c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151987 Aug 29 23:11:13.561453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1611/3328] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:13 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:14.582478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:14.583131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:14.589685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:14.590170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:14.590612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:14.591298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:14.591759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:14.592208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:14.723302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:14.731632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ac526d46-a05b-42c9-84ab-34426336a6da tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153548 Aug 29 23:11:14.732214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1718/3329] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:14 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:14.818183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:14.818745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:14.825124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:14.825605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:14.826037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:14.826752 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:14.827203 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:14.827625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:14.853959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:11:15.219567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-664fd5dd-d208-42a6-ab32-9f4112ee5021 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 204 len: 0 microversion: 2.1 time: 0.405250 Aug 29 23:11:15.220216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1612/3330] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:11:14 2022] DELETE /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:11:15.229017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:15.229630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:15.235714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:15.236230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:15.236669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:15.237978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:15.238642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:15.239110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:15.378509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:15.383890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-df58191f-15c5-4fb9-922a-f7c34f9045fb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1681 microversion: 2.1 time: 0.158704 Aug 29 23:11:15.384555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1719/3331] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:15 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:15.753653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:15.754280 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:15.760442 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:15.760928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:15.761357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:15.762068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:15.762551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:15.762978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:15.891458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:15.899603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7542a533-aeff-4b04-bd8f-570bf7ab1216 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150418 Aug 29 23:11:15.900187 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1613/3332] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:15 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:16.405232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:16.405876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:16.413378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:16.413860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:16.414816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:16.415002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:16.415459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:16.415888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:16.549226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:16.557534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e29e9887-5ba3-4f77-a47e-0c4f3ad4494c tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1681 microversion: 2.1 time: 0.156180 Aug 29 23:11:16.558104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1720/3333] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:16 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:16.921641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:16.922045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:16.930184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:16.930663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:16.931101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:16.931793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:16.932276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:16.932697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:17.075142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:17.085163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-82fdf3dd-8cb1-4b16-9a2b-fd5049cbcc89 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.167625 Aug 29 23:11:17.085733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1614/3334] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:16 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:17.579006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:17.579584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:17.587100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:17.587583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:17.588014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:17.588755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:17.589210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:17.589632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:17.794050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:17.802867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-759115ee-64ad-468b-932f-9854fb6efd91 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1681 microversion: 2.1 time: 0.227760 Aug 29 23:11:17.803669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1721/3335] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:17 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:18.106818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:18.107403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:18.114463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:18.114951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:18.115389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:18.116079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:18.116589 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:18.117012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:18.119727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:18.255729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-75197113-503b-4460-8c91-69efb84c240a req-3f60a584-f0ce-45b0-a602-2d39f35bf1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be965c9f-ec9c-41e9-af0a-d950543f8d3e", "name": "network-vif-deleted", "tag": "c8d15c01-e112-4626-b5b3-0070d0f3ad43"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:11:18.257962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:18.265512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-75197113-503b-4460-8c91-69efb84c240a req-3f60a584-f0ce-45b0-a602-2d39f35bf1ca service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:18.265993 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-75197113-503b-4460-8c91-69efb84c240a req-3f60a584-f0ce-45b0-a602-2d39f35bf1ca service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:18.266421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-75197113-503b-4460-8c91-69efb84c240a req-3f60a584-f0ce-45b0-a602-2d39f35bf1ca service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:18.266914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f319c823-ff60-4f11-81a5-98395a7dafaa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164002 Aug 29 23:11:18.267697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1615/3336] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:18 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:18.278117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-75197113-503b-4460-8c91-69efb84c240a req-3f60a584-f0ce-45b0-a602-2d39f35bf1ca service nova] Creating event network-vif-deleted:c8d15c01-e112-4626-b5b3-0070d0f3ad43 for instance be965c9f-ec9c-41e9-af0a-d950543f8d3e on hv-cinder-85426 Aug 29 23:11:18.283210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-75197113-503b-4460-8c91-69efb84c240a req-3f60a584-f0ce-45b0-a602-2d39f35bf1ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031633 Aug 29 23:11:18.284338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1722/3337] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:11:18.824689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:18.826123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:18.834029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:18.834520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:18.834960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:18.835654 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:18.836451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:18.836876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:18.879949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:18.880622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:18.881241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:18.881795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lazy-loading 'fault' on Instance uuid be965c9f-ec9c-41e9-af0a-d950543f8d3e {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:11:18.953119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:18.962582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-61000097-5d4b-4702-877a-16902cb09b99 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 200 len: 1332 microversion: 2.1 time: 0.141479 Aug 29 23:11:18.963583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1616/3338] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:18 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:19.289567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:19.290334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:19.305120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:19.305608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:19.306257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:19.306845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:19.307296 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:19.308445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:19.312962 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=92 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:19.457841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:19.469569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-892fad3a-32ca-4903-8f21-f0bfe8564976 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.185270 Aug 29 23:11:19.470164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1723/3339] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:19 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:19.987241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:19.987907 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:19.994315 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:19.994795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:19.995232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:19.996126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:19.996725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:19.997395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:20.012439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e HTTP/1.1 Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:11:20.026420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:11:20.028878 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': 'be965c9f-ec9c-41e9-af0a-d950543f8d3e'} Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:11:20.029990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:11:20.031866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:11:20.033543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:11:20.033543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dce8de99-758c-4631-a12a-8701716d1358 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 404 len: 111 microversion: 2.1 time: 0.032972 Aug 29 23:11:20.033543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1617/3340] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:19 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:11:20.033827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-732e3568-5921-45ba-9bc5-9eefa2977c39 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '.version_select at 0x7febd89fb3a0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:20.123254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-732e3568-5921-45ba-9bc5-9eefa2977c39 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016888996" status: 202 len: 0 microversion: 2.1 time: 0.101912 Aug 29 23:11:20.123831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1724/3341] 10.222.0.59 () {58 vars in 1221 bytes} [Mon Aug 29 23:11:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016888996 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:11:20.491727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:20.492219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:20.498463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:20.500122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:20.500593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:20.501300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:20.501787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:20.502225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:20.729106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:20.738628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ba059f46-8a2f-418b-9df9-edb30db08bcd tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.251444 Aug 29 23:11:20.739344 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1618/3342] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:20 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:21.017169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3be32904-82d6-4073-9a0d-2e934a9c169e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: .version_select at 0x7febd52ba430>, body: {"keypair": {"name": "tempest-keypair-1608182908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeq+HVUx0yw182i36lIQa1Sgf7b8hJvKKp17Qe+MZa6FjeDg3xqhhmH0Z8UuHEanY3oLfxflgBe5yIZ0a+BlEluBtCk/PH+Z76SqYg9BBeAv1LPVr2lC27NWEY/20WPKA=="}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:11:21.033085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-3be32904-82d6-4073-9a0d-2e934a9c169e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for project a826c462a3fa429eb866d354afcbe950. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:11:21.037600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-3be32904-82d6-4073-9a0d-2e934a9c169e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for user 9c2fdfdb62b54f05b7d81f14ec197cca and project a826c462a3fa429eb866d354afcbe950. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:11:21.147852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3be32904-82d6-4073-9a0d-2e934a9c169e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134959 Aug 29 23:11:21.148495 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1725/3343] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 23:11:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:11:21.759435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:21.760307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:21.767070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:21.767486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:21.768030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:21.769035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:21.769495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:21.769922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:21.928865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:21.943738 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4b405431-826a-4b44-ab59-b04a9332e5c7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.187510 Aug 29 23:11:21.944701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1619/3344] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:21 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:22.967919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:22.968555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:22.974675 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:22.975198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:22.975594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:22.976342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:22.976773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:22.977206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:23.123372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:23.132459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b87d75c2-891f-44d0-84a7-0a9fc04173a1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.168958 Aug 29 23:11:23.133049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1726/3345] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:22 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:23.250090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-420321450", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02e67e56-1d54-4626-ac0f-73743cdc8b11"}], "security_groups": [{"name": "tempest-securitygroup--1572699247"}], "key_name": "tempest-keypair-1608182908", "user_data": "}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:11:23.355860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.network.neutron [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] validate_networks() for [('02e67e56-1d54-4626-ac0f-73743cdc8b11', None, None, None, None, None)] {{(pid=128151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:11:23.740792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Flavor limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:11:23.741245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Image limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:11:23.741761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Flavor pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:11:23.742191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Image pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:11:23.742599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:11:23.751258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:23.751730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:23.752258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:23.753016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:23.753468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:23.753891 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:23.770962 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for project a826c462a3fa429eb866d354afcbe950. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:11:23.774832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Getting quotas for user 9c2fdfdb62b54f05b7d81f14ec197cca and project a826c462a3fa429eb866d354afcbe950. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:11:23.786414 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Going to run 1 instances... {{(pid=128151) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:11:23.788725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:11:23.932424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bad48938-e882-49ad-9610-94364b6c10bf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.686424 Aug 29 23:11:23.933081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1620/3346] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 23:11:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:11:23.944729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-035f123f-751c-46a0-8604-753f650025e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:23.945339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-035f123f-751c-46a0-8604-753f650025e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:23.999784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-035f123f-751c-46a0-8604-753f650025e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:24.007059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-035f123f-751c-46a0-8604-753f650025e9 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1241 microversion: 2.1 time: 0.066343 Aug 29 23:11:24.007755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1727/3347] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:23 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:24.153941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:24.154546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:24.161876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:24.162353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:24.162781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:24.163455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:24.163901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:24.164361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:24.296224 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:24.305311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a827a98d-931c-41e9-8fa5-2a3337b244bb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155248 Aug 29 23:11:24.305879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1621/3348] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:24 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:25.027100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-47c14989-7d97-420d-ba33-9d3295552972 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:25.027719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-47c14989-7d97-420d-ba33-9d3295552972 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:25.081734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-47c14989-7d97-420d-ba33-9d3295552972 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:25.089351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-47c14989-7d97-420d-ba33-9d3295552972 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1241 microversion: 2.1 time: 0.066252 Aug 29 23:11:25.089922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1728/3349] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:25 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:11:25.326472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:25.327021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:25.334114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:25.334600 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:25.335039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:25.335728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:25.336213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:25.336641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:25.468164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:25.476855 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e1a5c639-8af1-4124-90db-18b89e979f26 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154371 Aug 29 23:11:25.477455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1622/3350] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:25 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:26.110827 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2da1403f-98b0-4f41-8950-5382cf809dd1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:26.111980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2da1403f-98b0-4f41-8950-5382cf809dd1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:26.167249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2da1403f-98b0-4f41-8950-5382cf809dd1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:26.175066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2da1403f-98b0-4f41-8950-5382cf809dd1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1241 microversion: 2.1 time: 0.067985 Aug 29 23:11:26.175580 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1729/3351] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:26 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:26.498387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:26.498971 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:26.505392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:26.505861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:26.506289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:26.506955 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:26.507430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:26.507844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:26.639339 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:26.647784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-de58b639-111d-4534-ba2c-4380228fcc34 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153285 Aug 29 23:11:26.648379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1623/3352] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:26 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:27.195444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fe692a80-1227-40b0-946e-bbe220fd543a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:27.196001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fe692a80-1227-40b0-946e-bbe220fd543a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:27.249810 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fe692a80-1227-40b0-946e-bbe220fd543a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:27.257236 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fe692a80-1227-40b0-946e-bbe220fd543a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1241 microversion: 2.1 time: 0.065708 Aug 29 23:11:27.257828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1730/3353] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:27 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:27.668610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:27.669239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:27.671484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:27.677034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:27.677509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:27.677944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:27.678621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:27.679070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:27.679479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:27.808762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:27.818161 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-550d970f-9e6b-4692-b6e5-308122a27e79 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153395 Aug 29 23:11:27.818721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1624/3354] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:27 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:28.278365 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:28.278978 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:28.281394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:28.286560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:28.287049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:28.287487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:28.288229 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:28.288687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:28.289115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:28.354526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:28.362874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-01842ab3-aa8a-4a83-8483-fab9bd6e34f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1245 microversion: 2.1 time: 0.088587 Aug 29 23:11:28.363459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1731/3355] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:28 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:28.840250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:28.840888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:28.847435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:28.847919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:28.848384 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:28.849079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:28.849529 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:28.849954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:28.982114 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:28.991074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5fd27ecd-7513-41cb-a332-df66985db893 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155098 Aug 29 23:11:28.995839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1625/3356] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:28 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:29.383877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:29.384493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:29.391448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:29.391736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:29.392183 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:29.393614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:29.394641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:29.397934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:29.461249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:29.467643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-641ddc35-751a-4e68-b5b2-c68bb1ee3f4e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1293 microversion: 2.1 time: 0.087789 Aug 29 23:11:29.468266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1732/3357] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:29 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:30.012840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:30.013460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:30.019973 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:30.020495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:30.020967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:30.021614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:30.022057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:30.022473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:30.159616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:30.167990 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-14071674-4814-41a2-9250-d9743a09ae8b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158929 Aug 29 23:11:30.168608 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1626/3358] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:30 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:30.489839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:30.490395 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:30.496939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:30.497431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:30.497870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:30.498572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:30.499030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:30.499566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:30.596513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:30.604118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9e061d4d-0d93-4677-ab70-621106e88754 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1299 microversion: 2.1 time: 0.118969 Aug 29 23:11:30.604716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1733/3359] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:30 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:31.190056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:31.190650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:31.196958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:31.197435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:31.197866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:31.198546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:31.198988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:31.199401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:31.335898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:31.344207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-00a82d15-68b4-4350-a9fb-aa9ad09f9fe4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157963 Aug 29 23:11:31.344814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1627/3360] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:31 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:11:31.625916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:31.626665 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:31.633348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:31.633923 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:31.634371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:31.635070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:31.635529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:31.635959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:31.825470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:31.833868 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2a99091c-0777-4744-83df-0a859ad2326d tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1367 microversion: 2.1 time: 0.211852 Aug 29 23:11:31.834446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1734/3361] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:31 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:31.976687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-de756319-b564-4283-9123-2ada37695d0d req-cc12dee4-5f63-499b-9de0-601f994c736f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83618356-b1f8-42aa-a672-10fa645909b3", "tag": "52217a89-dc6a-442d-8fe3-fa8595dd9d21"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:11:31.986725 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-de756319-b564-4283-9123-2ada37695d0d req-cc12dee4-5f63-499b-9de0-601f994c736f service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:31.987204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-de756319-b564-4283-9123-2ada37695d0d req-cc12dee4-5f63-499b-9de0-601f994c736f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:31.987635 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-de756319-b564-4283-9123-2ada37695d0d req-cc12dee4-5f63-499b-9de0-601f994c736f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:31.998720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-de756319-b564-4283-9123-2ada37695d0d req-cc12dee4-5f63-499b-9de0-601f994c736f service nova] Creating event network-changed:52217a89-dc6a-442d-8fe3-fa8595dd9d21 for instance 83618356-b1f8-42aa-a672-10fa645909b3 on hv-cinder-85426 Aug 29 23:11:32.003876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-de756319-b564-4283-9123-2ada37695d0d req-cc12dee4-5f63-499b-9de0-601f994c736f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032991 Aug 29 23:11:32.004528 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1628/3362] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:11:32.366412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:32.367015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:32.373086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:32.373571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:32.374008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:32.374705 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:32.375150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:32.375569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:32.575424 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:32.584415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2bf3f131-d94d-4644-98d5-312f7e2a69ad tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.221782 Aug 29 23:11:32.584992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1735/3363] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:32 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:32.855831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:32.856548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:32.863084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:32.863557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:32.863986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:32.864689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:32.865135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:32.865552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:33.000757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:33.008722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-044f0975-b9b5-446d-a656-200cfaa286ae tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1367 microversion: 2.1 time: 0.157470 Aug 29 23:11:33.009615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1629/3364] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:32 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:33.605354 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:33.605954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:33.613004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:33.613485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:33.613911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:33.614585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:33.615059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:33.615476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:33.744960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:33.753081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8efa4fbb-e003-483f-aed1-8f9c153ad727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151627 Aug 29 23:11:33.753651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1736/3365] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:33 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:34.029805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:34.030396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:34.032449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:34.033590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=6 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:34.038937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:34.045097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:34.045097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:34.045097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:34.045097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:34.045541 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:34.171422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:34.179496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3f9da5bf-bd53-4672-bed4-3923c59ac0f1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1367 microversion: 2.1 time: 0.153570 Aug 29 23:11:34.180083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1630/3366] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:34 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:34.774274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:34.774855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:34.781488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:34.781973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:34.782413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:34.783751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:34.784239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:34.784674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:34.921297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:34.934718 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1dfa5002-892a-4336-a8c2-f913bee30494 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164550 Aug 29 23:11:34.935311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1737/3367] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:34 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:35.200252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:35.208751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:35.208751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:35.208751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:35.208751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:35.209207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:35.209503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:35.209936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:35.340867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:35.349173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a057dce1-c75d-4e00-9d5e-47692c0a4482 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1367 microversion: 2.1 time: 0.152948 Aug 29 23:11:35.349734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1631/3368] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:35 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:35.957677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:35.958291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:35.964850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:35.965333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:35.965766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:35.966449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:35.966903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:35.967320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:36.098202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:36.106441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4398de0f-74e1-4e0e-b952-c950cdc1c68d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153809 Aug 29 23:11:36.107006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1738/3369] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:35 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:36.370402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:36.371092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:36.378237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:36.378679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:36.379104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:36.379778 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:36.380251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:36.380669 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:36.510133 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:36.518246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cbf59d90-7c7e-406f-b32f-8610c8344f53 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1367 microversion: 2.1 time: 0.151583 Aug 29 23:11:36.518859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1632/3370] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:36 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:11:36.727219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-9962995b-e3f7-4e95-b83a-85fc5fccafd7 req-da93e402-8cd0-449d-9729-fe4bba47027d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83618356-b1f8-42aa-a672-10fa645909b3", "name": "network-vif-plugged", "status": "completed", "tag": "52217a89-dc6a-442d-8fe3-fa8595dd9d21"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:11:36.737407 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9962995b-e3f7-4e95-b83a-85fc5fccafd7 req-da93e402-8cd0-449d-9729-fe4bba47027d service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:36.737887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9962995b-e3f7-4e95-b83a-85fc5fccafd7 req-da93e402-8cd0-449d-9729-fe4bba47027d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:36.738316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-9962995b-e3f7-4e95-b83a-85fc5fccafd7 req-da93e402-8cd0-449d-9729-fe4bba47027d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:36.749516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-9962995b-e3f7-4e95-b83a-85fc5fccafd7 req-da93e402-8cd0-449d-9729-fe4bba47027d service nova] Creating event network-vif-plugged:52217a89-dc6a-442d-8fe3-fa8595dd9d21 for instance 83618356-b1f8-42aa-a672-10fa645909b3 on hv-cinder-85426 Aug 29 23:11:36.755083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-9962995b-e3f7-4e95-b83a-85fc5fccafd7 req-da93e402-8cd0-449d-9729-fe4bba47027d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Aug 29 23:11:36.755670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1739/3371] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:11:37.127468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:37.128077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:37.134311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:37.134901 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:37.135331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:37.136015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:37.136486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:37.136903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:37.151743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:37.266372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:37.274772 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-39c995ef-766b-439e-a03b-62769ff99b86 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151807 Aug 29 23:11:37.275340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1633/3372] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:37 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:37.537114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=12 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:37.541275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:37.542004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:37.548003 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:37.549392 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:37.549896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:37.550573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:37.551022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:37.551443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:37.683973 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:37.691612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-85b4eac1-96bd-4ef6-9a0f-2f9e57552877 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1367 microversion: 2.1 time: 0.155915 Aug 29 23:11:37.692188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1740/3373] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:37 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:38.296250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:38.296859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:38.303825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:38.304342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:38.304779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:38.305466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:38.305919 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:38.306346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:38.439826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:38.448091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-77141399-9108-4f9b-a1de-2a3f418be85e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155698 Aug 29 23:11:38.448677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1634/3374] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:38 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:38.712956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:38.713570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:38.720126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:38.726465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:38.726465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:38.726465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:38.726465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:38.727340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:38.860829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:38.869615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d40bc369-31aa-4057-a9fc-9b71e7070035 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1367 microversion: 2.1 time: 0.160567 Aug 29 23:11:38.870191 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1741/3375] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:38 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:39.470524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:39.471355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:39.477575 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:39.478050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:39.478478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:39.479148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:39.479591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:39.480005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:39.609184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:39.622628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7089596e-dff3-479c-a5ea-452ffbd373fb tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151332 Aug 29 23:11:39.622628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1635/3376] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:39 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:39.891113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:39.891722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:39.898510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:39.898990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:39.899425 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:39.900117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:39.900598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:39.901020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:40.037415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:40.045175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-969fc58e-73c9-433e-ac67-f54664808fe8 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1557 microversion: 2.1 time: 0.157931 Aug 29 23:11:40.045789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1742/3377] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:39 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:40.066585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d5ff89e3-4b40-468d-a8e6-459d24bbe28e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:40.067095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d5ff89e3-4b40-468d-a8e6-459d24bbe28e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:40.073268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5ff89e3-4b40-468d-a8e6-459d24bbe28e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:40.073749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5ff89e3-4b40-468d-a8e6-459d24bbe28e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:40.074185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5ff89e3-4b40-468d-a8e6-459d24bbe28e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:40.074867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5ff89e3-4b40-468d-a8e6-459d24bbe28e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:40.075327 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5ff89e3-4b40-468d-a8e6-459d24bbe28e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:40.075750 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d5ff89e3-4b40-468d-a8e6-459d24bbe28e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:40.155241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d5ff89e3-4b40-468d-a8e6-459d24bbe28e tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092699 Aug 29 23:11:40.155960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1636/3378] 10.222.0.59 () {58 vars in 1275 bytes} [Mon Aug 29 23:11:40 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:11:40.644548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:40.645697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:40.656413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:40.657347 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:40.658154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:40.659476 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:40.660329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:40.661080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:40.796484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:40.806605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9adb9f41-f843-49af-803b-b364694c6671 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.170252 Aug 29 23:11:40.807189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1743/3379] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:40 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:41.215021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-cbdeb375-fb52-4195-9fe7-3bb56d17a2d1 req-ec690235-45b6-469a-be10-82ad05bec9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83618356-b1f8-42aa-a672-10fa645909b3", "tag": "52217a89-dc6a-442d-8fe3-fa8595dd9d21"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:11:41.225134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-cbdeb375-fb52-4195-9fe7-3bb56d17a2d1 req-ec690235-45b6-469a-be10-82ad05bec9b9 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:41.225681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-cbdeb375-fb52-4195-9fe7-3bb56d17a2d1 req-ec690235-45b6-469a-be10-82ad05bec9b9 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:41.226178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-cbdeb375-fb52-4195-9fe7-3bb56d17a2d1 req-ec690235-45b6-469a-be10-82ad05bec9b9 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:41.238317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-cbdeb375-fb52-4195-9fe7-3bb56d17a2d1 req-ec690235-45b6-469a-be10-82ad05bec9b9 service nova] Creating event network-changed:52217a89-dc6a-442d-8fe3-fa8595dd9d21 for instance 83618356-b1f8-42aa-a672-10fa645909b3 on hv-cinder-85426 Aug 29 23:11:41.244521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-cbdeb375-fb52-4195-9fe7-3bb56d17a2d1 req-ec690235-45b6-469a-be10-82ad05bec9b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033484 Aug 29 23:11:41.245120 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1637/3380] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:11:41.831618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:41.832311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:41.839147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:41.839679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:41.840099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:41.840848 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:41.841369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:41.841798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:41.993478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:42.002721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-75b6429a-82cc-4a78-be29-2601d2d9abf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.175191 Aug 29 23:11:42.003708 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1744/3381] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:41 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:43.026061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:43.026680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:43.033908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:43.034434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:43.034873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:43.035578 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:43.036030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:43.036484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:43.173953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:43.182397 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0beed51f-ddc4-448b-a984-cfce82a5c74e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.161483 Aug 29 23:11:43.182968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1638/3382] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:43 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:44.215243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:44.215243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:44.215243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:44.215243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:44.216185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:44.216185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:44.216185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:44.216185 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:44.347920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:44.356156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-29662a69-012c-401d-a12c-362c0acc8299 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156992 Aug 29 23:11:44.356730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1745/3383] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:44 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:45.377909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:45.378610 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:45.385666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:45.386153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:45.386590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:45.387296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:45.387808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:45.388273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:45.523135 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:45.531329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-55060d77-ae47-44dd-b67f-7ce00a60197d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157991 Aug 29 23:11:45.531856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1639/3384] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:45 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:46.553502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:46.554148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:46.560724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:46.561208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:46.561642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:46.562334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:46.562787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:46.563215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:46.578551 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=100 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:46.695963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:46.704344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c62d8f49-008d-4f93-a5db-64838a388eb6 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155527 Aug 29 23:11:46.706478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1746/3385] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:46 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:47.725779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:47.726409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:47.733552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:47.734031 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:47.734466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:47.735146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:47.735591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:47.736004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:47.866467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:47.874577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-426f19e3-e2a3-4ec1-a6f1-245c42913289 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153650 Aug 29 23:11:47.875153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1640/3386] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:47 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:48.897406 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:48.898004 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:48.904605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:48.905088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:48.905513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:48.906200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:48.906648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:48.907071 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:49.042417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:49.051432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2c3773c4-dd41-435c-aa3b-62f75fb372fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158727 Aug 29 23:11:49.051997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1747/3387] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:48 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:50.072514 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:50.073112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:50.079777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:50.080446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:50.080885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:50.081579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:50.082026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:50.082452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:50.214956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:50.223735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bd5d2608-23f9-45dc-8d0f-32c754bcbfae tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155146 Aug 29 23:11:50.224453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1641/3388] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:50 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:51.245444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:51.246072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:51.253317 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:51.253838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:51.254281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:51.254986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:51.255444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:51.255869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:51.392346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:51.400820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-82188e39-c4c6-4ddc-8656-33b5373f8d1e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159260 Aug 29 23:11:51.401388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1748/3389] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:51 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:52.421857 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:52.422480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:52.429683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:52.430166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:52.430594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:52.431277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:52.432282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:52.432282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:52.563677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:52.572743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e57aa575-92fe-4bf9-a593-09e54252e565 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154894 Aug 29 23:11:52.573321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1642/3390] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:52 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:53.594677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:53.595310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:53.602581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:53.603069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:53.603506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:53.604224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:53.604679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:53.605111 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:53.742380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:53.750540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-688f0c0a-f487-4d5a-bae7-301325c3c12c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159719 Aug 29 23:11:53.751114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1749/3391] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:53 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:54.772013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:54.772698 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:54.779323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:54.779798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:54.780257 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:54.780945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:54.781393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:54.781812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:54.919997 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:54.930548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7246c05d-8f79-4ffc-9a1b-98eec3d0f4d0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.162344 Aug 29 23:11:54.931140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1643/3392] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:54 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:55.952343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:55.952951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:55.959131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:55.959610 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:55.960049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:55.960765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:55.961216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:55.961638 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:56.092636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:56.102745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-64616202-0199-4504-93ac-3e5e72bc0eb2 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154026 Aug 29 23:11:56.103336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1750/3393] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:55 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:57.125492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:57.126128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:57.133018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:57.133496 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:57.133923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:57.134629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:57.135074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:57.135493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:57.268844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:57.277779 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-343e96cd-ff5d-412f-9812-6961b9f22b6f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156065 Aug 29 23:11:57.278353 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1644/3394] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:57 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:58.299843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:58.300438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:58.307618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:58.308089 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:58.308542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:58.309214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:58.309660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:58.310073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:58.439601 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:58.448223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c5d01c54-6029-42cf-a065-6a0979cf7521 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152493 Aug 29 23:11:58.448798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1751/3395] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:58 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:11:59.469216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:11:59.469822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:11:59.472293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=42 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:59.477121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:59.477607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:59.478042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:59.478728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:11:59.479185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:11:59.479605 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:11:59.612434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:11:59.628221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-907ddd09-7461-40b2-ae9c-5df80fbeeeb8 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.162483 Aug 29 23:11:59.630308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1645/3396] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:11:59 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:00.650430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:00.651076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:00.653452 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=42 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:00.658085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:00.658557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:00.658983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:00.659660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:00.660420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:00.660846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:00.794162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:00.802997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d920898c-447e-47a5-bb49-c36c9267176c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156537 Aug 29 23:12:00.803568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1752/3397] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:00 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:01.824820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:01.825502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:01.832355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:01.832791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:01.833216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:01.833889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:01.834340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:01.834755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:01.978342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:01.987852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f4027e18-0754-48ce-826d-37b09d879f04 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.166781 Aug 29 23:12:01.989398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1646/3398] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:01 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:03.010924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:03.011483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:03.018018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:03.018517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:03.018955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:03.020500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:03.020906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:03.021337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:03.155921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:03.165083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-79a84465-673c-41ae-ad31-8b1410ac4cc3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158233 Aug 29 23:12:03.165759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1753/3399] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:03 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:12:04.186666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:04.192343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:04.194018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:04.194499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:04.194932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:04.195628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:04.196075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:04.196540 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:04.325775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:04.334626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c52ae33d-d190-479b-b4f8-9404d9c9d56b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151839 Aug 29 23:12:04.335194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1647/3400] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:04 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:05.356323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:05.356883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:05.364059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:05.364574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:05.365015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:05.365713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:05.366211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:05.366636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:05.497413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:05.505866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-aa879bad-28b7-43e1-b237-66aeb9014d4e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153545 Aug 29 23:12:05.506441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1754/3401] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:05 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:06.526475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:06.564391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:06.564391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:06.564391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:06.564391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:06.564849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:06.564849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:06.564849 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:06.669703 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:06.678928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b6584a26-dee6-4aba-ae84-40e4ad9edba5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156257 Aug 29 23:12:06.679567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1648/3402] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:06 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:07.700370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:07.700991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:07.707472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:07.707959 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:07.708428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:07.709121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:07.709617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:07.710045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:07.837991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:07.846274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d24cc931-6d1e-4025-a2cc-dba2bd474ec5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.149820 Aug 29 23:12:07.846867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1755/3403] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:07 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:08.868804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:08.869419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:08.876573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:08.877061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:08.877554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:08.878300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:08.878823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:08.879380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:08.882066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=88 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:09.014554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:09.022993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-11582597-0e66-4ef1-a232-bd31f857b8b0 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158427 Aug 29 23:12:09.023566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1649/3404] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:08 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:10.045175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:10.047430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:10.053728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:10.054206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:10.054824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:10.056381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:10.056561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:10.057012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:10.367541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:10.376042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a97a2d2d-2797-46f3-bcff-de397f9de578 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.334921 Aug 29 23:12:10.376653 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1756/3405] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:10 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:11.399629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:11.400256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:11.406684 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:11.407153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:11.407576 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:11.408312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:11.408757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:11.409169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:11.540741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:11.549124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-68aeb786-6c57-479a-a8d9-d7ce4e3e95f1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153343 Aug 29 23:12:11.549720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1650/3406] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:11 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:12:12.571737 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:12.572360 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:12.578832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:12.579309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:12.579739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:12.580453 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:12.580901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:12.581319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:12.713787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:12.722232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3a677146-0d7e-4ce5-8c9f-8df3555756ff tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154341 Aug 29 23:12:12.723026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1757/3407] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:12 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:13.743523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:13.744086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:13.750546 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:13.751028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:13.751463 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:13.752157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:13.752626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:13.753045 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:14.121914 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:14.130301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-779d9e37-39b3-4664-b187-c8bcdc303650 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.390719 Aug 29 23:12:14.130867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1651/3408] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:13 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:15.151448 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:15.152097 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:15.158760 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:15.159241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:15.163714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:15.163714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:15.163714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:15.163714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:15.295924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:15.304710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-588bcccb-90c2-4d6b-af40-2c336b421bf4 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157071 Aug 29 23:12:15.305281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1758/3409] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:15 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:16.326142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:16.326710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:16.333622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:16.334101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:16.334570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:16.335473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:16.335948 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:16.336400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:16.468058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:16.476851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0a2060ed-5483-4e8b-a187-4a1eebb5cd4b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154662 Aug 29 23:12:16.477420 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1652/3410] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:16 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:17.198278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d8828ebf-a160-4ee0-9e75-6916999703b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:17.198875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d8828ebf-a160-4ee0-9e75-6916999703b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:17.205068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8828ebf-a160-4ee0-9e75-6916999703b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:17.210428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8828ebf-a160-4ee0-9e75-6916999703b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:17.210428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8828ebf-a160-4ee0-9e75-6916999703b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:17.210428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8828ebf-a160-4ee0-9e75-6916999703b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:17.210428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8828ebf-a160-4ee0-9e75-6916999703b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:17.210896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8828ebf-a160-4ee0-9e75-6916999703b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:17.210896 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=76 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:17.232805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d8828ebf-a160-4ee0-9e75-6916999703b1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3/ips" status: 200 len: 149 microversion: 2.1 time: 0.038954 Aug 29 23:12:17.233315 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1759/3411] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 23:12:17 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:12:17.498102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:17.498701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:17.505579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:17.506740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:17.507437 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:17.508278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:17.508869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:17.509398 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:17.754310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:17.764063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b434552e-c526-48b8-8b2c-f73dd47d92d1 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.270457 Aug 29 23:12:17.765141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1653/3412] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:17 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:18.785546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:18.786160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:18.793929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:18.794781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:18.794939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:18.795553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:18.796012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:18.796560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:18.930257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:18.938538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eb2a24d0-3aed-43f1-9361-8f197edbeadf tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156927 Aug 29 23:12:18.939113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1760/3413] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:18 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:19.959452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:19.960059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:19.966650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:19.967121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:19.967547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:19.968258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:19.968713 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:19.969128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:20.096216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:20.105461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d76fe0b3-c9fc-4834-b6a9-56972433fc14 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150033 Aug 29 23:12:20.106038 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1654/3414] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:19 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:21.126709 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:21.127321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:21.134866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:21.135498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:21.136045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:21.136937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:21.137512 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:21.138032 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:21.269966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:21.278469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a6f9815f-ac76-4874-9da8-678f05c471e9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155727 Aug 29 23:12:21.279019 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1761/3415] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:21 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:22.299177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:22.299825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:22.306163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:22.306642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:22.307080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:22.307763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:22.308245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:22.308671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:22.439307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:22.448184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-461e9de2-2075-4ba7-9e84-6fb0497a13e7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153193 Aug 29 23:12:22.448780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1655/3416] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:22 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:23.469787 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:23.470415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:23.477488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:23.477964 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:23.478393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:23.479072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:23.479521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:23.479940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:23.611669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:23.620192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6e5e24a3-938c-45b0-a976-d771bd62bf7f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154171 Aug 29 23:12:23.620751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1762/3417] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:23 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:24.641385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:24.642032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:24.648758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:24.649245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:24.649680 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:24.650374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:24.650832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:24.651260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:24.787553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:24.795767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-80f20d93-9804-4b68-b370-cda8b0595448 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158247 Aug 29 23:12:24.796364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1656/3418] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:24 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:12:25.818820 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:25.819590 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:25.825532 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:25.826017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:25.826456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:25.827141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:25.827602 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:25.828024 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:25.956199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:25.964729 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1669fb74-c51b-4406-a20c-c2cf96d92c56 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150555 Aug 29 23:12:25.965293 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1763/3419] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:25 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:26.986231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:26.986838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:26.993886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:26.994360 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:26.994785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:26.995456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:26.995899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:26.996349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:27.125094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:27.133751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4c9d0201-2a16-4ec0-91e9-6ee30b3ead27 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151354 Aug 29 23:12:27.134321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1657/3420] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:26 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:28.155158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:28.155790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:28.162934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:28.163409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:28.163841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:28.164660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:28.165113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:28.165530 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:28.294218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:28.302833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-387cd60b-1558-4dbf-afa0-3df721c268fa tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151516 Aug 29 23:12:28.303391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1764/3421] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:28 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:29.323502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:29.324112 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:29.330560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:29.331039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:29.331473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:29.332173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:29.332630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:29.333084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:29.462200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:29.470511 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-454f9346-94c8-444e-bffd-c22f4e84a84b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150938 Aug 29 23:12:29.471088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1658/3422] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:29 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:30.494326 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:30.495228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:30.501673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:30.502151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:30.502579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:30.503263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:30.503715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:30.504152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:30.636404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:30.644613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-202efb53-5591-43da-99d0-fc9757e113ce tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155388 Aug 29 23:12:30.645176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1765/3423] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:30 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:12:31.666941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:31.667596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:31.669469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=28 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:31.674620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:31.674998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:31.675434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:31.676126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:31.676606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:31.677688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:31.812876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:31.821341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-84814c31-0b3b-4d1a-9516-a13c1a076abc tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159314 Aug 29 23:12:31.821920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1659/3424] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:31 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:32.842724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:32.843321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:32.845700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=28 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:32.850468 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:32.850946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:32.851376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:32.852083 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:32.852556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:32.852976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:32.986870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:32.995660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e579c78e-0f9c-4060-b157-95a792b1c78d tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156776 Aug 29 23:12:32.996252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1766/3425] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:32 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:34.017622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:34.018217 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:34.024920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:34.025389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:34.025814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:34.026489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:34.026998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:34.027419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:34.159487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:34.168569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-54633395-7562-4ec9-9e2f-f2b3c4614b31 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154766 Aug 29 23:12:34.169148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1660/3426] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:34 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:35.190584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:35.191204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:35.198171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:35.198648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:35.199080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:35.199836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:35.200321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:35.200748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:35.337034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:35.346475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9f305ae9-1865-4928-add4-05a39e61ab44 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159739 Aug 29 23:12:35.347040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1767/3427] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:35 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:36.368602 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:36.369220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:36.375705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:36.376237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:36.376672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:36.377362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:36.377818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:36.378244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:36.508122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:36.516244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ae1e4413-86a7-423b-8301-e724438e0700 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152210 Aug 29 23:12:36.516810 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1661/3428] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:36 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:37.537887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:37.538474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:37.544914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:37.545393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:37.545829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:37.546770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:37.547266 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:37.547697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:37.677618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:37.686543 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bf7dbcdb-0a42-4b2b-947e-6f4316db5d28 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152629 Aug 29 23:12:37.687128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1768/3429] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:37 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:38.708820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:38.716746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:38.716746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:38.716746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:38.717093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:38.717499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:38.717956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:38.718375 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:38.856385 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:38.865228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-55e0f1ed-d442-4de1-809b-d8c8d4623298 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160502 Aug 29 23:12:38.865802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1662/3430] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:38 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:39.886560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:39.887163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:39.893594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:39.894077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:39.894513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:39.895877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:39.896437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:39.896866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:40.028922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:40.037696 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f66b146e-bb20-4d5d-9e82-5bbb820c6ce9 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.154903 Aug 29 23:12:40.038276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1769/3431] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:39 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:41.058652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:41.059205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:41.065705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:41.066177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:41.066599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:41.067273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:41.067716 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:41.068164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:41.070702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=84 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:41.204036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:41.210865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0ea5877b-2003-48d3-990d-6a4c0450b603 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156154 Aug 29 23:12:41.211431 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1663/3432] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:41 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:42.232333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:42.232913 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:42.239274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:42.239789 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:42.241222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:42.241924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:42.242384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:42.242812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:42.375906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:42.384300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9cc1a774-d703-436f-b37f-43671db2a3f7 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156300 Aug 29 23:12:42.384867 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1770/3433] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:42 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:43.406024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:43.406617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:43.413252 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:43.414407 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:43.414846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:43.415539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:43.415992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:43.416434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:43.549966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:43.558229 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-575d887e-94a1-4d25-9251-557e43989029 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156421 Aug 29 23:12:43.558800 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1664/3434] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:43 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:44.579230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:44.579841 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:44.586363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:44.586840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:44.587273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:44.587952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:44.588427 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:44.588850 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:44.717694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:44.726278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d42a5215-cee3-428d-abe7-a82f60d33862 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150398 Aug 29 23:12:44.726845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1771/3435] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:44 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:45.747604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:45.748194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:45.754566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:45.755042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:45.755473 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:45.756168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:45.756631 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:45.757690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:45.888075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:45.896226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ad32e66e-3dce-4bbf-91f0-efcd3f7bd748 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152558 Aug 29 23:12:45.896809 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1665/3436] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:45 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:46.916193 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:46.916728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:46.923750 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:46.924308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:46.924751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:46.925454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:46.925915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:46.926346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:47.063240 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:47.072225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6e0e67a9-260a-4ef9-847d-cb56a16903db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160069 Aug 29 23:12:47.072802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1772/3437] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:46 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:48.093732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:48.094337 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:48.101434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:48.101923 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:48.102354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:48.103040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:48.103493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:48.103911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:48.232262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:48.240535 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f79102fa-dd95-4006-afe8-43a493e57398 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150653 Aug 29 23:12:48.241103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1666/3438] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:48 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:49.261548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:49.262143 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:49.275589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:49.276068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:49.276572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:49.277220 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:49.277669 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:49.278088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:49.280661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=82 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:49.407028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:49.415855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0e9ca8d9-86a6-4eda-be7b-1e2bd0e09355 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158294 Aug 29 23:12:49.416478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1773/3439] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:49 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:50.437288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:50.437910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:50.444290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:50.444765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:50.445274 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:50.446010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:50.446460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:50.446881 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:50.577063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:50.585132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1a2f7b9f-4d01-4258-9cab-f90386aabfa5 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151699 Aug 29 23:12:50.585708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1667/3440] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:50 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:51.607041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:51.607798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:51.615429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:51.615983 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:51.616458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:51.617151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:51.617614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:51.618587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:51.750066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:51.758210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3775d130-93b9-4cfc-be4e-26a72eb4cd55 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.155957 Aug 29 23:12:51.759612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1774/3441] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:51 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:52.779747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:52.780464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:52.786457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:52.786935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:52.787377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:52.788069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:52.788545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:52.788965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:52.916887 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:52.925596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f2fd3755-111a-4c26-badf-899c02ea768f tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.149865 Aug 29 23:12:52.926180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1668/3442] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:52 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:53.947205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:53.948035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:53.955248 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:53.955857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:53.956340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:53.957034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:53.957538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:53.957960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:54.335558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:54.344410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-cf9bfe67-6b88-4559-9e91-befd73d1c758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.401365 Aug 29 23:12:54.344966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1775/3443] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:53 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:55.366984 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:55.367653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:55.374869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:55.375389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:55.375885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:55.376577 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:55.377036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:55.377466 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:55.514449 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:55.522642 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-02afca20-21ff-4302-a129-ef2da12a4a64 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.160110 Aug 29 23:12:55.523212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1669/3444] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:55 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:56.543603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:56.544281 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:56.546997 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:12:56.547142 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d (ip 10.222.0.59) !!! Aug 29 23:12:56.553890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:56.554379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:56.554816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:56.555514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:56.555970 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:56.556446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:56.684084 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:56.692128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a3d9d8dc-639b-4d00-befc-1a3871ec7789 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153132 Aug 29 23:12:56.692704 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1776/3445] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:56 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:57.712957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:57.713959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:57.722305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:57.722927 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:57.723507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:57.724604 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:57.725288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:57.725865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:57.858647 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:57.866671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-72bb3b74-ce89-42be-bc6b-52e04a8ee568 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157928 Aug 29 23:12:57.867231 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1670/3446] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:57 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:12:58.887998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:12:58.888651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:12:58.895302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:58.895781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:58.896585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:58.897280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:12:58.897730 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:12:58.898153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:12:59.029865 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:12:59.038124 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-38c9a734-5ce6-4b82-9c97-a4dd0de3b1db tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153936 Aug 29 23:12:59.038689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1777/3447] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:12:58 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:00.060234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:00.060839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:00.067331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:00.067813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:00.068271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:00.068954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:00.069406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:00.069825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:00.200253 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:00.208568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1132334b-3e1a-4e0b-8de2-0a470d3f4590 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152862 Aug 29 23:13:00.209182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1671/3448] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:00 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:01.230356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:01.231734 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:01.238022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:01.245358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:01.245358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:01.245358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:01.245358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:01.245832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:01.370907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:01.379131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b4bc581c-6830-48f7-87a9-625a883695ac tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152754 Aug 29 23:13:01.379695 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1778/3449] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:01 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:02.400482 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:02.401094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:02.403421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=26 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:02.408172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:02.408658 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:02.409096 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:02.409787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:02.410233 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:02.410660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:02.547286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:02.555468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5787fa7e-3759-4d03-8f2f-a7a0c76c643a tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.158929 Aug 29 23:13:02.556040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1672/3450] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:02 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:03.577902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:03.578521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:03.580874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=26 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:03.585544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:03.586030 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:03.586591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:03.587216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:03.587947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:03.588405 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:03.718832 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:03.727009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-035d476f-42b6-4ed9-aef3-e60a8259c727 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.153597 Aug 29 23:13:03.727585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1779/3451] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:03 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:04.748041 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:04.748681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:04.755208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:04.755695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:04.756123 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:04.756833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:04.757286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:04.757707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:04.886583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:04.895566 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6d320c1d-714b-4985-b75c-6168271150b3 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.151331 Aug 29 23:13:04.896176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1673/3452] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:04 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:05.916550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:05.917162 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:05.925034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:05.925529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:05.925971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:05.926672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:05.927130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:05.927559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:06.055054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:06.063470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b56c80c8-7805-482f-95a1-3ab5e0033758 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150845 Aug 29 23:13:06.064044 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1780/3453] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:05 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:07.084836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:07.085430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:07.092478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:07.092953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:07.093380 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:07.094057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:07.094498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:07.094909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:07.227931 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:07.237048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5f2ad207-ee15-459d-bc0b-94ce2b8ad71c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156124 Aug 29 23:13:07.237617 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1674/3454] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:07 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:08.258288 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:08.258845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:08.265328 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:08.265804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:08.266233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:08.266915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:08.267361 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:08.267777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:08.398731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:08.407376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6786d94b-76c7-4e40-a474-11be58718010 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152957 Aug 29 23:13:08.407947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1781/3455] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:08 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:09.429377 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:09.430012 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:09.436433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:09.436910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:09.437852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:09.438539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:09.438987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:09.439402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:09.573409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:09.582507 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8915aefb-c11a-4cb6-9e55-b8b3b45b2a51 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156971 Aug 29 23:13:09.583174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1675/3456] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:09 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:10.603639 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:10.604265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:10.610893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:10.611378 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:10.611823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:10.612548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:10.613068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:10.613506 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:10.741632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:10.749960 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6225316e-9801-44f5-afba-fc38b444f39c tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150158 Aug 29 23:13:10.750528 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1782/3457] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:10 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:11.771269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:11.771885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:11.778322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:11.778796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:11.779230 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:11.779910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:11.780383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:11.780806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:11.785341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=78 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:11.909683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:11.918014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e32a8f29-a094-4018-aa77-3ff6c5b09c93 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.150537 Aug 29 23:13:11.918593 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1676/3458] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:11 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:12.940011 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:12.940654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:12.947151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:12.947631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:12.948060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:12.948781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:12.949222 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:12.949640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:13.086333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:13.095971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-8044bdd9-0c55-428b-b276-06056f35f116 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.159555 Aug 29 23:13:13.095971 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1783/3459] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:12 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:14.116389 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:14.117000 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:14.123661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:14.124172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:14.124682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:14.125858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:14.126429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:14.126851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:14.260001 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:14.268708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e0dcf335-2ed3-4a0c-8117-588a6e6dd39b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.156223 Aug 29 23:13:14.269278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1677/3460] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:14 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:15.289943 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:15.290692 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:15.297728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:15.298381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:15.298821 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:15.299554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:15.300049 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:15.300502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:15.434849 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:15.443616 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4e4874bb-9111-46ea-b5fe-7ee8442f660b tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.157522 Aug 29 23:13:15.444200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1784/3461] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:15 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:16.465495 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:16.466101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:16.473760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:16.474254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:16.474682 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:16.475361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:16.475812 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:16.476265 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:16.605212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:16.613509 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8ff29c9c-e780-4201-8949-207c9ea2320e tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.152009 Aug 29 23:13:16.614075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1678/3462] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:16 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:17.400732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:17.401239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:17.408196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:17.408627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:17.409057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:17.409748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:17.410198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:17.410614 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:17.438090 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:13:17.634299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:17.634958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:17.642107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:17.647067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:17.647067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:17.647067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:17.647067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:17.647474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:17.725343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-38e5fe87-d05b-47a4-9bb4-f249670bdf2f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 204 len: 0 microversion: 2.1 time: 0.422223 Aug 29 23:13:17.726145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1785/3463] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:13:17 2022] DELETE /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:13:17.735204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:17.735980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:17.742914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:17.743438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:17.744592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:17.744738 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:17.745127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:17.745575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:17.786219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:17.795451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cd065b21-eb2d-40d7-943b-fd893fa7c981 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.164882 Aug 29 23:13:17.796237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1679/3464] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:17 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:13:17.883894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:17.892871 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b54694e1-5830-42f1-a0de-40b7b2450949 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1681 microversion: 2.1 time: 0.162453 Aug 29 23:13:17.893557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1786/3465] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:17 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:18.827317 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:18.830827 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] [instance: 97ddee20-0f21-4105-80d6-d388c1146f7d] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:18.835160 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:18.835653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:18.836083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:18.836804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:18.837322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:18.837746 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:18.914290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:18.914870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:18.925216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:18.925765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:18.926217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:18.926924 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:18.927375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:18.927998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:18.977802 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484c09f238bd4b0d91b6aeaee913f7d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c0dcefe769247eaa49da038e336bc8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:18.986376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-633792e6-215e-4148-8ca2-2bd98d32f681 tempest-VolumesSnapshotTestJSON-942660605 tempest-VolumesSnapshotTestJSON-942660605-project] 10.222.0.59 "GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d" status: 200 len: 1559 microversion: 2.1 time: 0.163098 Aug 29 23:13:18.986969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1680/3466] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:18 2022] GET /compute/v2.1/servers/97ddee20-0f21-4105-80d6-d388c1146f7d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:19.094824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:19.102768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9a89a914-bd6d-4abc-9061-0c74ac66c3be tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1681 microversion: 2.1 time: 0.192571 Aug 29 23:13:19.103352 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1787/3467] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:18 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:13:20.124194 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:20.124938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:20.132557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:20.132557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:20.132980 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:20.133690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:20.134325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:20.134758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:20.215154 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:20.224245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e71a194b-e6f5-4c4e-99f1-369409e6e1b2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1613 microversion: 2.1 time: 0.104252 Aug 29 23:13:20.225305 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1681/3468] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:20 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:20.538460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-a25bb779-4ec2-4dfe-9cd0-6d5930c08352 req-0e6c322e-e9c3-40d5-b0bb-ecacd864c7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83618356-b1f8-42aa-a672-10fa645909b3", "name": "network-vif-deleted", "tag": "52217a89-dc6a-442d-8fe3-fa8595dd9d21"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:13:20.551074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-a25bb779-4ec2-4dfe-9cd0-6d5930c08352 req-0e6c322e-e9c3-40d5-b0bb-ecacd864c7c0 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:20.551855 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-a25bb779-4ec2-4dfe-9cd0-6d5930c08352 req-0e6c322e-e9c3-40d5-b0bb-ecacd864c7c0 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:20.552487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-a25bb779-4ec2-4dfe-9cd0-6d5930c08352 req-0e6c322e-e9c3-40d5-b0bb-ecacd864c7c0 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:20.557890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:20.566966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-a25bb779-4ec2-4dfe-9cd0-6d5930c08352 req-0e6c322e-e9c3-40d5-b0bb-ecacd864c7c0 service nova] Creating event network-vif-deleted:52217a89-dc6a-442d-8fe3-fa8595dd9d21 for instance 83618356-b1f8-42aa-a672-10fa645909b3 on hv-cinder-85426 Aug 29 23:13:20.572726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-a25bb779-4ec2-4dfe-9cd0-6d5930c08352 req-0e6c322e-e9c3-40d5-b0bb-ecacd864c7c0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091644 Aug 29 23:13:20.574095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1788/3469] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:13:21.245651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:21.246429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:21.254264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:21.254747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:21.255179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:21.255871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:21.256357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:21.257795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:21.293835 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:21.294320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:21.295013 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:21.295465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lazy-loading 'fault' on Instance uuid 83618356-b1f8-42aa-a672-10fa645909b3 {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:13:21.341774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2fdfdb62b54f05b7d81f14ec197cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a826c462a3fa429eb866d354afcbe950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:13:21.350220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ed892099-776d-4158-9c0f-7f612cc9dfdb tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 200 len: 1331 microversion: 2.1 time: 0.108439 Aug 29 23:13:21.350804 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1682/3470] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:21 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:13:22.372866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:22.373560 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:22.383858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:22.383858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:22.383858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:22.383858 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:22.384390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:22.384390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:22.398492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 HTTP/1.1 Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:13:22.400194 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:22.402498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '83618356-b1f8-42aa-a672-10fa645909b3'} Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:13:22.403761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:22.405561 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:22.407367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:13:22.407367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-dbb90707-1be9-425c-af89-6e361b0ddac1 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 404 len: 111 microversion: 2.1 time: 0.034019 Aug 29 23:13:22.407367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1789/3471] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:22 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:13:22.412333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-beaebfa4-9bff-447b-b4c8-717b1bc5cef3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '.version_select at 0x7febd4ff99d0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:22.543552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-beaebfa4-9bff-447b-b4c8-717b1bc5cef3 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608182908" status: 202 len: 0 microversion: 2.1 time: 0.135576 Aug 29 23:13:22.544240 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1683/3472] 10.222.0.59 () {58 vars in 1221 bytes} [Mon Aug 29 23:13:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608182908 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:13:23.392838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:23.393979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:23.401267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.401748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.402180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.402875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.403320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.403740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.418176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 HTTP/1.1 Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:13:23.419940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.422189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '83618356-b1f8-42aa-a672-10fa645909b3'} Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:13:23.423217 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.424887 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.426860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:13:23.426860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0b98847f-5722-4996-b195-c8533e23374a tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 404 len: 111 microversion: 2.1 time: 0.033423 Aug 29 23:13:23.426860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1790/3473] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:13:23 2022] DELETE /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:13:23.432215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:23.432833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 83618356-b1f8-42aa-a672-10fa645909b3] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:23.439405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.439889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.440417 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.441116 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.441567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.441992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.457195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 HTTP/1.1 Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:13:23.458978 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.461067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '83618356-b1f8-42aa-a672-10fa645909b3'} Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:13:23.462188 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. Aug 29 23:13:23.463908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.465446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance 83618356-b1f8-42aa-a672-10fa645909b3 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:13:23.465446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3efb3baf-eed2-4277-b7c8-2080153f8f14 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3" status: 404 len: 111 microversion: 2.1 time: 0.032183 Aug 29 23:13:23.465446 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1684/3474] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:23 2022] GET /compute/v2.1/servers/83618356-b1f8-42aa-a672-10fa645909b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:13:23.469860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:23.470356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:23.477569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.478081 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.478564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.479305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.479766 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.480226 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.494394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e HTTP/1.1 Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:13:23.496095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.497765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': 'be965c9f-ec9c-41e9-af0a-d950543f8d3e'} Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:13:23.498749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.500513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.502138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:13:23.502138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4e23f037-e2de-4dba-a512-513df876e240 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 404 len: 111 microversion: 2.1 time: 0.032255 Aug 29 23:13:23.502138 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1791/3475] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:13:23 2022] DELETE /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:13:23.509247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:23.509903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: be965c9f-ec9c-41e9-af0a-d950543f8d3e] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:23.517143 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.517545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.517985 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.518706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.519159 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.519591 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.534739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e HTTP/1.1 Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:13:23.536391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.538177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': 'be965c9f-ec9c-41e9-af0a-d950543f8d3e'} Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:13:23.539182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. Aug 29 23:13:23.540892 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.542356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance be965c9f-ec9c-41e9-af0a-d950543f8d3e could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:13:23.542356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-02d8a70b-8b20-43e7-b942-d3fb8666f088 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e" status: 404 len: 111 microversion: 2.1 time: 0.033769 Aug 29 23:13:23.542356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1685/3476] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:23 2022] GET /compute/v2.1/servers/be965c9f-ec9c-41e9-af0a-d950543f8d3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:13:23.547037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:23.547559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:23.553801 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.554470 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.554920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.555631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.556086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.556598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.571779 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff HTTP/1.1 Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:13:23.573414 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.575261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '3f93cf86-a1d6-46b8-8b19-07daf0b193ff'} Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:13:23.576331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.578093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.580292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:13:23.580292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-80e19102-bcac-49e5-8bc4-2dd7ad967caf tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 404 len: 111 microversion: 2.1 time: 0.032148 Aug 29 23:13:23.580292 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1792/3477] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:13:23 2022] DELETE /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:13:23.585710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:13:23.586345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 3f93cf86-a1d6-46b8-8b19-07daf0b193ff] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:13:23.595329 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.595824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.596297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.597007 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:13:23.597469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:13:23.597894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:13:23.612519 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff HTTP/1.1 Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:13:23.614104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.615922 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '3f93cf86-a1d6-46b8-8b19-07daf0b193ff'} Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:13:23.616972 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. Aug 29 23:13:23.618625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:13:23.620158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance 3f93cf86-a1d6-46b8-8b19-07daf0b193ff could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:13:23.620158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-915f7930-b392-4dea-8e25-8a7879ebf80f tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff" status: 404 len: 111 microversion: 2.1 time: 0.034705 Aug 29 23:13:23.620158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1686/3478] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:13:23 2022] GET /compute/v2.1/servers/3f93cf86-a1d6-46b8-8b19-07daf0b193ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:15:20.016771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:20.017946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=9 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:20.019151 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:15:20.019370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c (ip 10.222.0.59) !!! Aug 29 23:15:20.024335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:15:20.025254 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:15:20.036817 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:15:20.037311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:15:20.037754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:15:20.038541 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:15:20.039007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:15:20.039465 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:15:20.058239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] HTTP exception thrown: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Request method failure captured: Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c HTTP/1.1 Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEuuOn3fAMm-vmkfkzgy3YqCQiJSnWcAQ32q5zqpLHxaYYBd5Pnw3CWZTh9sU8mZ0Xq2svzUF921MogkriqHtKTylN0iZrPnpWanq3EHkTNtOYYe96baQ5L80gFKXUb8NsN7wPFJ8z9aSZE0U63hawbzOCRdPr5RjUlJQfnal2FyL0 Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:15:20.060698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df7ab727f89e4fcb9933c2098b4fb501", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeTestJSON-127938805-project Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 43cdaa09925c4b00be3b45cea4fd40b7 Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeTestJSON-127938805-project Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.062764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': 'b82aaeac-b1e6-4be1-a5a5-0605c648b05c'} Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:15:20.063829 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.069215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.071228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Returning 404 to user: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:15:20.071228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3894f22c-ccdc-4e57-b8ec-dbd191cc6e95 tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 404 len: 111 microversion: 2.1 time: 0.047797 Aug 29 23:15:20.071228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1793/3479] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:15:20 2022] DELETE /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:15:20.071512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b8a9a3b2-fc3c-468a-8a51-7b8624cb581d] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 23:15:20.072190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:20.073055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=49 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:20.073889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:15:20.074014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c (ip 10.222.0.59) !!! Aug 29 23:15:20.076817 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:15:20.076979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c (ip 10.222.0.59) !!! Aug 29 23:15:20.083107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:15:20.083700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] [instance: b82aaeac-b1e6-4be1-a5a5-0605c648b05c] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:15:20.096410 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:15:20.097169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:15:20.097652 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:15:20.098498 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:15:20.098959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:15:20.099461 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:15:20.114277 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] HTTP exception thrown: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Request method failure captured: Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c HTTP/1.1 Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUEuuOn3fAMm-vmkfkzgy3YqCQiJSnWcAQ32q5zqpLHxaYYBd5Pnw3CWZTh9sU8mZ0Xq2svzUF921MogkriqHtKTylN0iZrPnpWanq3EHkTNtOYYe96baQ5L80gFKXUb8NsN7wPFJ8z9aSZE0U63hawbzOCRdPr5RjUlJQfnal2FyL0 Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:15:20.115780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_df7ab727f89e4fcb9933c2098b4fb501", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/df7ab727f89e4fcb9933c2098b4fb501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: df7ab727f89e4fcb9933c2098b4fb501 Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-AttachVolumeTestJSON-127938805 Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-AttachVolumeTestJSON-127938805-project Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 43cdaa09925c4b00be3b45cea4fd40b7 Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-AttachVolumeTestJSON-127938805-project Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.117780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': 'b82aaeac-b1e6-4be1-a5a5-0605c648b05c'} Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:15:20.118791 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. Aug 29 23:15:20.120486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:15:20.122247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] Returning 404 to user: Instance b82aaeac-b1e6-4be1-a5a5-0605c648b05c could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:15:20.122247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aae08f12-1f5e-47e8-991d-fd68c54db82d tempest-AttachVolumeTestJSON-127938805 tempest-AttachVolumeTestJSON-127938805-project] 10.222.0.59 "GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c" status: 404 len: 111 microversion: 2.1 time: 0.048338 Aug 29 23:15:20.122247 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1687/3480] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:15:20 2022] GET /compute/v2.1/servers/b82aaeac-b1e6-4be1-a5a5-0605c648b05c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:17:20.610869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1f080f3b-0fd2-4de8-bc6f-0359e6c58244] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 23:17:20.612502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:20.613624 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:17:20.613791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 (ip 10.222.0.59) !!! Aug 29 23:17:20.615609 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:17:20.615875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 (ip 10.222.0.59) !!! Aug 29 23:17:20.646232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:17:20.647006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:17:20.657968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:17:20.658732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:17:20.659660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:17:20.660977 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:17:20.661899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:17:20.662516 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:17:20.686755 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] HTTP exception thrown: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Request method failure captured: Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 HTTP/1.1 Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUEposl7iWvuVxr5iRqmEYz9T2-nelP1ZyY41W0xpo910Wd7us3SyThpO_WRA--bUEex36LVRr5JFm1rUu1q4GZNtQ82R5ZYMn7IiehvUXlHHNhJyXvYGkpYIdkTzwH71z4IF3Htb5vLVA5l8YtjufKPF48puwEDG7qnYlyhlY3eOjM Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:17:20.688410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d45f8dd557e14a6483ebe7e39d902641", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 42a287a54c4040ac828ee221a3f2e8c7 Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.690421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '7e568957-b28a-4d75-b458-3f8e95bb38d0'} Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:17:20.691840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.693726 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.695931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Returning 404 to user: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:17:20.695931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-73038eb2-b8a4-4aa8-93f2-7f25d5f2ce2a tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 404 len: 111 microversion: 2.20 time: 0.080929 Aug 29 23:17:20.695931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1794/3481] 10.222.0.59 () {60 vars in 1280 bytes} [Mon Aug 29 23:17:20 2022] DELETE /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:17:20.697553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:17:20.698054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 (ip 10.222.0.59) !!! Aug 29 23:17:20.703838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:17:20.704475 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] [instance: 7e568957-b28a-4d75-b458-3f8e95bb38d0] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:17:20.714718 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:17:20.723316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:17:20.723316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:17:20.723316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:17:20.723316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:17:20.723771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:17:20.723863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] [b8a9a3b2-fc3c-468a-8a51-7b8624cb581d] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 56610. Aug 29 23:17:20.733825 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] HTTP exception thrown: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Request method failure captured: Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 HTTP/1.1 Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUEposl7iWvuVxr5iRqmEYz9T2-nelP1ZyY41W0xpo910Wd7us3SyThpO_WRA--bUEex36LVRr5JFm1rUu1q4GZNtQ82R5ZYMn7IiehvUXlHHNhJyXvYGkpYIdkTzwH71z4IF3Htb5vLVA5l8YtjufKPF48puwEDG7qnYlyhlY3eOjM Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:17:20.735382 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d45f8dd557e14a6483ebe7e39d902641", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d45f8dd557e14a6483ebe7e39d902641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: d45f8dd557e14a6483ebe7e39d902641 Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2022823030 Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 42a287a54c4040ac828ee221a3f2e8c7 Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2022823030-project Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.737052 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '7e568957-b28a-4d75-b458-3f8e95bb38d0'} Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:17:20.737960 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. Aug 29 23:17:20.739438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:17:20.741862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] Returning 404 to user: Instance 7e568957-b28a-4d75-b458-3f8e95bb38d0 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:17:20.741862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1795a35b-89f1-4fa2-b065-145805a3ca06 tempest-AttachVolumeShelveTestJSON-2022823030 tempest-AttachVolumeShelveTestJSON-2022823030-project] 10.222.0.59 "GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0" status: 404 len: 111 microversion: 2.20 time: 0.042183 Aug 29 23:17:20.741862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1688/3482] 10.222.0.59 () {60 vars in 1277 bytes} [Mon Aug 29 23:17:20 2022] GET /compute/v2.1/servers/7e568957-b28a-4d75-b458-3f8e95bb38d0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:19:13.227717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:13.233599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:13.233599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=4 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:19:13.233599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:19:13.233599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:19:13.233599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:19:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe (ip 10.222.0.59) !!! Aug 29 23:19:13.242782 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:13.243263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:13.243904 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:13.244627 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:13.245077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:13.245500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:13.276333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:19:13.283063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] [1f080f3b-0fd2-4de8-bc6f-0359e6c58244] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 56796. Aug 29 23:19:13.656521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7da80a0f-5f1a-4f7b-94bd-08257ab08588 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 204 len: 0 microversion: 2.1 time: 0.432947 Aug 29 23:19:13.657364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1795/3483] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:19:13 2022] DELETE /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:19:13.663570 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=4 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:19:13.664522 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:19:13.664723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:19:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe (ip 10.222.0.59) !!! Aug 29 23:19:13.665747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:19:13.665854 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:19:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe (ip 10.222.0.59) !!! Aug 29 23:19:13.670176 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:13.670767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:13.680440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:13.680928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:13.681368 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:13.682056 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:13.682557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:13.682969 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:14.133487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:19:14.141399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2cc17d87-d3f7-451e-b6c4-6134e33c9ea6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1508 microversion: 2.1 time: 0.479932 Aug 29 23:19:14.141979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1689/3484] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:13 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1508 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:19:15.164719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:15.165557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:15.172242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:15.172746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:15.173230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:15.173940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:15.174391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:15.174819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:15.595198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:19:15.604198 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fbeccd82-db9e-4f75-b283-bd725ba4afec tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1508 microversion: 2.1 time: 0.444295 Aug 29 23:19:15.604783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1796/3485] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:15 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:19:16.628401 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:16.630655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:16.644650 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:16.645286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:16.646480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:16.647331 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:16.648227 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:16.648847 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:16.948268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:19:16.958462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-784822b6-95e2-4f93-9f2c-004ce32a1218 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1508 microversion: 2.1 time: 0.335501 Aug 29 23:19:16.960963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1690/3486] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:16 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:19:17.609744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-13b578d5-911c-41a2-829d-205f06e7fc9b req-2df7c019-5497-4ceb-9cbe-8413a5dcb4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bc49c0-59c8-4adc-9c9a-a43adb38c922", "name": "network-vif-deleted", "tag": "3230f74d-5d52-4d21-bcb2-a8da0c68daca"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:19:17.632221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-13b578d5-911c-41a2-829d-205f06e7fc9b req-2df7c019-5497-4ceb-9cbe-8413a5dcb4b8 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:17.632992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-13b578d5-911c-41a2-829d-205f06e7fc9b req-2df7c019-5497-4ceb-9cbe-8413a5dcb4b8 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:17.633746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-13b578d5-911c-41a2-829d-205f06e7fc9b req-2df7c019-5497-4ceb-9cbe-8413a5dcb4b8 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:17.676944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-13b578d5-911c-41a2-829d-205f06e7fc9b req-2df7c019-5497-4ceb-9cbe-8413a5dcb4b8 service nova] Creating event network-vif-deleted:3230f74d-5d52-4d21-bcb2-a8da0c68daca for instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 on hv-cinder-85426 Aug 29 23:19:17.694649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-13b578d5-911c-41a2-829d-205f06e7fc9b req-2df7c019-5497-4ceb-9cbe-8413a5dcb4b8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377043 Aug 29 23:19:17.694649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1797/3487] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:19:17.733850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-4e1f8ce8-4e28-4929-9ff3-fe5bc350936b req-f55d83b7-3d2e-4396-82a9-86623f532e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b065522-3ef5-4124-b4bd-87f54e94e0fe", "name": "network-vif-deleted", "tag": "818cb0ea-72e6-4a8a-ba82-e595795a4d22"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:19:17.759322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-4e1f8ce8-4e28-4929-9ff3-fe5bc350936b req-f55d83b7-3d2e-4396-82a9-86623f532e01 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:17.759777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-4e1f8ce8-4e28-4929-9ff3-fe5bc350936b req-f55d83b7-3d2e-4396-82a9-86623f532e01 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:17.760237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-4e1f8ce8-4e28-4929-9ff3-fe5bc350936b req-f55d83b7-3d2e-4396-82a9-86623f532e01 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:17.782322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-4e1f8ce8-4e28-4929-9ff3-fe5bc350936b req-f55d83b7-3d2e-4396-82a9-86623f532e01 service nova] Creating event network-vif-deleted:818cb0ea-72e6-4a8a-ba82-e595795a4d22 for instance 1b065522-3ef5-4124-b4bd-87f54e94e0fe on hv-cinder-85426 Aug 29 23:19:17.796705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-4e1f8ce8-4e28-4929-9ff3-fe5bc350936b req-f55d83b7-3d2e-4396-82a9-86623f532e01 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201497 Aug 29 23:19:17.797443 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1691/3488] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:19:17.986546 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:17.987159 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:17.997484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:18.000873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:18.001804 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:18.004446 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:18.006980 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:18.008207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:18.113920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:19:18.131485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-38f14c82-4777-4057-b30a-5bae077eaa3e tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1292 microversion: 2.1 time: 0.150553 Aug 29 23:19:18.132441 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1798/3489] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:17 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1292 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:19:19.156464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:19.157354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:19.163623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:19.164162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:19.164606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:19.165291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:19.165740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:19.166163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:19.202092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:19.202583 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:19.203054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:19.203462 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lazy-loading 'fault' on Instance uuid 1b065522-3ef5-4124-b4bd-87f54e94e0fe {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:19:19.259103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:19:19.268916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-80e6a61d-141b-4eed-9db1-e6968ca87f86 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 200 len: 1311 microversion: 2.1 time: 0.117803 Aug 29 23:19:19.270411 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1692/3490] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:19 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:19:19.706165 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-889d192e-ca18-41f8-96fd-f5118150c1da req-578ed9d7-4202-415e-ab8a-eb9fc647cfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ddee20-0f21-4105-80d6-d388c1146f7d", "name": "network-vif-deleted", "tag": "0e534abd-48b9-4065-800c-833daa6bb98c"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:19:19.717308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-889d192e-ca18-41f8-96fd-f5118150c1da req-578ed9d7-4202-415e-ab8a-eb9fc647cfc0 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:19.717785 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-889d192e-ca18-41f8-96fd-f5118150c1da req-578ed9d7-4202-415e-ab8a-eb9fc647cfc0 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:19.718312 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-889d192e-ca18-41f8-96fd-f5118150c1da req-578ed9d7-4202-415e-ab8a-eb9fc647cfc0 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:19.730126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-889d192e-ca18-41f8-96fd-f5118150c1da req-578ed9d7-4202-415e-ab8a-eb9fc647cfc0 service nova] Creating event network-vif-deleted:0e534abd-48b9-4065-800c-833daa6bb98c for instance 97ddee20-0f21-4105-80d6-d388c1146f7d on hv-cinder-85426 Aug 29 23:19:19.735620 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-889d192e-ca18-41f8-96fd-f5118150c1da req-578ed9d7-4202-415e-ab8a-eb9fc647cfc0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032835 Aug 29 23:19:19.737458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1799/3491] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:19:20.291497 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:20.292183 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 1b065522-3ef5-4124-b4bd-87f54e94e0fe] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:20.298792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:20.299276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:20.299840 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:20.300551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:20.301006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:20.301428 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:20.316557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] HTTP exception thrown: Instance 1b065522-3ef5-4124-b4bd-87f54e94e0fe could not be found. Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Request method failure captured: Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe HTTP/1.1 Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUEw39NdTrxy5ryUt7omGBmI5smeJUc6U5eIQs41bdzVIByqPiCTClAVg1N75emU49t-aXJl3Vcrmpmm85kYfR_AR8Z9kJwiODBs4iNDGPP1tlx3n9rv2xGstyMmjtPKu_0hIY2-67xrpRyAazwfklpDKDMR7ps0Q4VwGdVpVV0pnkk Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 66de012537ed40e3bc233b80458bcfc4 Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:19:20.319058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_66de012537ed40e3bc233b80458bcfc4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 66de012537ed40e3bc233b80458bcfc4 Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-ServerRescueNegativeTestJSON-948463503-project Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: cc2f5c40aedf47dcb6374d64fcb04add Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948463503-project Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 1b065522-3ef5-4124-b4bd-87f54e94e0fe could not be found. Aug 29 23:19:20.324620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '1b065522-3ef5-4124-b4bd-87f54e94e0fe'} Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b065522-3ef5-4124-b4bd-87f54e94e0fe could not be found. Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:19:20.325697 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b065522-3ef5-4124-b4bd-87f54e94e0fe could not be found. Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b065522-3ef5-4124-b4bd-87f54e94e0fe could not be found. Aug 29 23:19:20.327453 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:20.329011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Returning 404 to user: Instance 1b065522-3ef5-4124-b4bd-87f54e94e0fe could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:19:20.329011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ccdba59d-bcad-4fba-9ec1-d34cda3cdc01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe" status: 404 len: 111 microversion: 2.1 time: 0.033463 Aug 29 23:19:20.329011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1693/3492] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:20 2022] GET /compute/v2.1/servers/1b065522-3ef5-4124-b4bd-87f54e94e0fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:19:20.329768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:20.330345 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:20.337253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:20.337744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:20.344563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:20.344563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:20.344563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:20.344563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:20.364783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:19:20.663790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5e11a8fe-9b61-49a1-b084-354f9fcc4a01 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "DELETE /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 204 len: 0 microversion: 2.1 time: 0.337904 Aug 29 23:19:20.665139 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1800/3493] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:19:20 2022] DELETE /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:19:20.673806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:20.674758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:20.705049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:20.705049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:20.705049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:20.705049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:20.705439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:20.705439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:20.856322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:19:20.864010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-422cd9cc-2737-422a-8c50-6c42294640f6 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1521 microversion: 2.1 time: 0.194736 Aug 29 23:19:20.864607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1694/3494] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:20 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:19:21.885148 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:21.885834 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:21.892261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:21.892747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:21.893175 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:21.893937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:21.894385 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:21.894805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:22.026256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:19:22.038039 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-853571c3-d9e5-4153-a748-125f23b14dc8 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1479 microversion: 2.1 time: 0.156691 Aug 29 23:19:22.039762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1801/3495] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:21 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1479 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:19:22.064627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-ac4de96d-3791-4772-90c2-d3b720fbf21c req-51b21d98-bf70-4dc2-a742-381162f1e999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91aa52d5-e323-47c3-b4ea-6f4391575689", "name": "network-vif-deleted", "tag": "6be4ff40-5348-4f0a-b930-dd182b22d3a4"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:19:22.081787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-ac4de96d-3791-4772-90c2-d3b720fbf21c req-51b21d98-bf70-4dc2-a742-381162f1e999 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:22.082548 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-ac4de96d-3791-4772-90c2-d3b720fbf21c req-51b21d98-bf70-4dc2-a742-381162f1e999 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:22.083286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-ac4de96d-3791-4772-90c2-d3b720fbf21c req-51b21d98-bf70-4dc2-a742-381162f1e999 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:22.098764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-ac4de96d-3791-4772-90c2-d3b720fbf21c req-51b21d98-bf70-4dc2-a742-381162f1e999 service nova] Creating event network-vif-deleted:6be4ff40-5348-4f0a-b930-dd182b22d3a4 for instance 91aa52d5-e323-47c3-b4ea-6f4391575689 on hv-cinder-85426 Aug 29 23:19:22.105571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-ac4de96d-3791-4772-90c2-d3b720fbf21c req-51b21d98-bf70-4dc2-a742-381162f1e999 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045776 Aug 29 23:19:22.110423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1695/3496] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:19:23.135660 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:23.136450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:23.143540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:23.144025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:23.144526 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:23.145205 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:23.145840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:23.146886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:23.179177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:23.179752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:23.180204 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:23.180654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lazy-loading 'fault' on Instance uuid 91aa52d5-e323-47c3-b4ea-6f4391575689 {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:19:23.223615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2f5c40aedf47dcb6374d64fcb04add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66de012537ed40e3bc233b80458bcfc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:19:23.234663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0311155b-1577-48d2-a640-15b2fd090267 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 200 len: 1311 microversion: 2.1 time: 0.103910 Aug 29 23:19:23.234999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1802/3497] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:23 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:19:24.258689 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:19:24.260076 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] [instance: 91aa52d5-e323-47c3-b4ea-6f4391575689] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:19:24.269192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:24.270282 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:24.271094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:24.271826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:19:24.272314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:19:24.272764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:19:24.288852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] HTTP exception thrown: Instance 91aa52d5-e323-47c3-b4ea-6f4391575689 could not be found. Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Request method failure captured: Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 HTTP/1.1 Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUEw39NdTrxy5ryUt7omGBmI5smeJUc6U5eIQs41bdzVIByqPiCTClAVg1N75emU49t-aXJl3Vcrmpmm85kYfR_AR8Z9kJwiODBs4iNDGPP1tlx3n9rv2xGstyMmjtPKu_0hIY2-67xrpRyAazwfklpDKDMR7ps0Q4VwGdVpVV0pnkk Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 66de012537ed40e3bc233b80458bcfc4 Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:19:24.290797 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_66de012537ed40e3bc233b80458bcfc4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/66de012537ed40e3bc233b80458bcfc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 66de012537ed40e3bc233b80458bcfc4 Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948463503 Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-ServerRescueNegativeTestJSON-948463503-project Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: cc2f5c40aedf47dcb6374d64fcb04add Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948463503-project Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 91aa52d5-e323-47c3-b4ea-6f4391575689 could not be found. Aug 29 23:19:24.297464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '91aa52d5-e323-47c3-b4ea-6f4391575689'} Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91aa52d5-e323-47c3-b4ea-6f4391575689 could not be found. Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:19:24.298852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91aa52d5-e323-47c3-b4ea-6f4391575689 could not be found. Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91aa52d5-e323-47c3-b4ea-6f4391575689 could not be found. Aug 29 23:19:24.300722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:19:24.302246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] Returning 404 to user: Instance 91aa52d5-e323-47c3-b4ea-6f4391575689 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:19:24.302246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-307c7a38-167e-45bf-bc1e-28c3226f2ef9 tempest-ServerRescueNegativeTestJSON-948463503 tempest-ServerRescueNegativeTestJSON-948463503-project] 10.222.0.59 "GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689" status: 404 len: 111 microversion: 2.1 time: 0.039692 Aug 29 23:19:24.302246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1696/3498] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:19:24 2022] GET /compute/v2.1/servers/91aa52d5-e323-47c3-b4ea-6f4391575689 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:20:22.750231 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-160acada-04cd-485e-93f7-4124f162f252 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Action: 'create', calling method: .version_select at 0x7febd89e4430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1215415109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkITiEqfwRybtDJgX2kWVwXUpEtBcRr9nBORR79TewR5u6g31jxzQhvkEOzPHKXHVNihWjqNhWiy71aBGsAHc/Zg8uW+utfu5ViIKebrWGL1B2FjWbtAMxRKG/sU2Y2hA=="}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:20:22.755861 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:22.756549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:22.767990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-160acada-04cd-485e-93f7-4124f162f252 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Getting quotas for project 8b61dd30bd20426990ed70288f69e40b. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:20:22.772119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-160acada-04cd-485e-93f7-4124f162f252 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Getting quotas for user 79a2748b61b4451f9215a4f8eea5dea2 and project 8b61dd30bd20426990ed70288f69e40b. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:20:22.880661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-160acada-04cd-485e-93f7-4124f162f252 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.134197 Aug 29 23:20:22.881257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1803/3499] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 23:20:22 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:20:22.936530 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1522143212", "imageRef": "cb6b1bd2-c0e2-4a1b-b79f-9a37d0704d23", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1215415109", "networks": [{"uuid": "2ea6ca70-dd60-4c3f-92bf-91e6a19bcae0"}]}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:20:22.945177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=22 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:22.946090 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=34 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:22.992523 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.network.neutron [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] validate_networks() for [('2ea6ca70-dd60-4c3f-92bf-91e6a19bcae0', None, None, None, None, None)] {{(pid=128151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:20:23.508675 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Flavor limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:20:23.509095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Image limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:20:23.509634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Flavor pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:20:23.510408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Image pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:20:23.510739 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:20:23.519451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:23.520072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:23.520538 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:23.521260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:23.521708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:23.522132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:23.539036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Getting quotas for project 8b61dd30bd20426990ed70288f69e40b. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:20:23.543862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Getting quotas for user 79a2748b61b4451f9215a4f8eea5dea2 and project 8b61dd30bd20426990ed70288f69e40b. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:20:23.555561 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Going to run 1 instances... {{(pid=128151) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:20:23.558706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb6b1bd2-c0e2-4a1b-b79f-9a37d0704d23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:20:23.680850 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6f2f7ac0-2018-42e1-afeb-23ef6a2c1d69 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748412 Aug 29 23:20:23.682124 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1697/3500] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 23:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:20:23.693314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0bb9e85b-0eb6-4994-8591-60cde858305c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:23.700045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0bb9e85b-0eb6-4994-8591-60cde858305c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:23.761259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0bb9e85b-0eb6-4994-8591-60cde858305c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:23.768420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0bb9e85b-0eb6-4994-8591-60cde858305c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1259 microversion: 2.1 time: 0.079209 Aug 29 23:20:23.769028 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1804/3501] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:23 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1259 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:24.793392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-91c4f6d3-118f-4c7b-b34a-19de00b819d0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:24.794091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-91c4f6d3-118f-4c7b-b34a-19de00b819d0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:24.851667 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-91c4f6d3-118f-4c7b-b34a-19de00b819d0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:24.858532 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-91c4f6d3-118f-4c7b-b34a-19de00b819d0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1259 microversion: 2.1 time: 0.071325 Aug 29 23:20:24.859093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1698/3502] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:24 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:25.879285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:25.879911 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:25.890195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:25.890677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:25.891114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:25.891802 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:25.892285 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:25.892713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:25.957521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:25.966180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-00657c57-80e8-40ba-9c07-1c4a27c75f62 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1311 microversion: 2.1 time: 0.091022 Aug 29 23:20:25.967056 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1805/3503] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:25 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:26.993024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:26.994059 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:27.002866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:27.003362 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:27.003793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:27.004612 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:27.005070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:27.005483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:27.141235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:27.148872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e8c457e5-31aa-44b8-ae79-7980bb577c22 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.163951 Aug 29 23:20:27.149432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1699/3504] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:26 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:28.170510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:28.171120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:28.177575 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:28.177990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:28.178417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:28.179110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:28.179567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:28.179984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:28.305355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:28.313331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f68c458c-de56-4626-bc28-caefe74a12b2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.146684 Aug 29 23:20:28.313886 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1806/3505] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:28 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:29.334416 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:29.334976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:29.341920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:29.342405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:29.342834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:29.343526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:29.343976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:29.344425 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:29.471035 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:29.478643 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-00136511-49e7-4ed6-9ada-14eb1a90d50e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.148096 Aug 29 23:20:29.479379 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1700/3506] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:29 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:30.498826 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:30.499428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:30.505845 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:30.506325 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:30.506757 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:30.507437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:30.507931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:30.508375 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:30.639742 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:30.647547 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ed975f93-1cc4-40eb-b95a-a7006064183d tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.152542 Aug 29 23:20:30.648119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1807/3507] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:30 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:31.671748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:31.673346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:31.687018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:31.687767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:31.688422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:31.689500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:31.690149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:31.690873 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:31.880492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:31.889665 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3faf2cb0-079d-40c3-9e35-7157a289b78b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.223811 Aug 29 23:20:31.890310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1701/3508] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:31 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:31.952009 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-047111ca-852e-4096-9d82-45e80fbdecff req-0717ba5f-19c9-4150-a300-1a2889f5a912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02641e15-15cb-43b8-bcf0-26e27655413a", "tag": "3a81e763-66f0-4256-8dff-721180b77137"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:20:31.964170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-047111ca-852e-4096-9d82-45e80fbdecff req-0717ba5f-19c9-4150-a300-1a2889f5a912 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:31.967892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-047111ca-852e-4096-9d82-45e80fbdecff req-0717ba5f-19c9-4150-a300-1a2889f5a912 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:31.967892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-047111ca-852e-4096-9d82-45e80fbdecff req-0717ba5f-19c9-4150-a300-1a2889f5a912 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:31.978123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-047111ca-852e-4096-9d82-45e80fbdecff req-0717ba5f-19c9-4150-a300-1a2889f5a912 service nova] Creating event network-changed:3a81e763-66f0-4256-8dff-721180b77137 for instance 02641e15-15cb-43b8-bcf0-26e27655413a on hv-cinder-85426 Aug 29 23:20:31.983793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-047111ca-852e-4096-9d82-45e80fbdecff req-0717ba5f-19c9-4150-a300-1a2889f5a912 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036151 Aug 29 23:20:31.984631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1808/3509] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:20:32.912343 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:32.912932 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:32.919777 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:32.920581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:32.921195 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:32.922494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:32.923149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:32.923859 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:33.080214 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:33.095022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1ceac357-187f-4511-b192-927c1d5aae15 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.186321 Aug 29 23:20:33.105986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1702/3510] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:32 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:34.116006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=6 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:34.120906 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:34.121597 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:34.127531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:34.128016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:34.128498 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:34.129188 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:34.129642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:35.095239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:35.095239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:35.095239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-660e52e2-bdb6-499e-a48e-9bf7e10f41ba tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.178754 Aug 29 23:20:35.095239 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1809/3511] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:34 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:35.314822 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:35.315470 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:35.317395 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:35.318736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=8 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:35.324670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:35.325163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:35.325581 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:35.326376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:35.326830 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:35.327272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:35.472283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:35.480722 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-78d77b62-0d9b-43c0-a06b-f45b30a80321 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.169674 Aug 29 23:20:35.481322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1703/3512] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:35 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:36.503888 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:36.504540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:36.512355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:36.513712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:36.513712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:36.514579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:36.515036 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:36.515606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:36.663635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:36.678037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4f50c926-a588-4c81-be3f-f2fa47c90e3f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.174131 Aug 29 23:20:36.678037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1810/3513] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:36 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:37.695707 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:37.696551 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:37.703376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:37.703986 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:37.704565 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:37.705326 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:37.705852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:37.706754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:37.907757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:37.925630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-73b984ae-3b4e-4172-b7ef-86fb18654933 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.234262 Aug 29 23:20:37.926469 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1704/3514] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:37 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:38.948268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:38.948952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:38.955684 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:38.956192 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:38.956632 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:38.957394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:38.957859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:38.958275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:39.112397 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:39.123654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-aa3d09cc-73e9-4077-bdc9-e52cbe0b83d9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.179509 Aug 29 23:20:39.124299 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1811/3515] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:38 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:40.144064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:40.144700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:40.151490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:40.152022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:40.152489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:40.153175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:40.153625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:40.154087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:40.289633 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:40.298064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bc321bdd-8103-4a4e-a994-7b1ef88e6143 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.157974 Aug 29 23:20:40.298641 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1705/3516] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:40 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:41.317778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:41.318432 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:41.326012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:41.326500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:41.326939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:41.327635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:41.328116 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:41.328641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:41.457698 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:41.465554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e039822d-560b-4a44-acf0-e99c2a741274 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.151571 Aug 29 23:20:41.466136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1812/3517] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:41 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:42.488118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:42.488799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:42.495773 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:42.496273 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:42.496711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:42.497402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:42.508413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:42.508413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:42.634084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:42.641027 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5fa33ce3-3812-48c4-9886-cb8a3cf09534 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.156763 Aug 29 23:20:42.641748 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1706/3518] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:42 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:43.662559 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:43.663168 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:43.669450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:43.675213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:43.675213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:43.675213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:43.675213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:43.675488 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:43.810413 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:43.818101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c7234b45-9017-4b80-8c92-9d9a1ea520c6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.159450 Aug 29 23:20:43.818661 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1813/3519] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:43 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:44.840883 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:44.841531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:44.848190 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:44.848730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:44.849167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:44.850198 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:44.850692 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:44.851119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:44.989784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:44.998513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-dbb00948-d21e-4252-b11b-0f732ab9b75b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.162030 Aug 29 23:20:44.999373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1707/3520] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:44 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:46.019388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:46.020093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:46.026654 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:46.027173 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:46.027662 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:46.028387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:46.028846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:46.029449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:46.171355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:46.179421 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-87249b1f-d516-4723-84a7-076fd0dd02f9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.163749 Aug 29 23:20:46.180429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1814/3521] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:46 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:47.201793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:47.202333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:47.208733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:47.209208 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:47.209638 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:47.210309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:47.210764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:47.211167 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:47.340412 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:47.348055 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-94df64ea-c749-48e6-b44c-7c8d7b067ab3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.150824 Aug 29 23:20:47.348655 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1708/3522] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:47 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:48.368848 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:48.369512 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:48.376943 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:48.377423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:48.377852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:48.378543 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:48.378988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:48.379406 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:48.516842 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-6aad7f52-5d7d-46e0-897e-413259b88132 req-69281236-0bcd-47dd-8947-7a6c51a008ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02641e15-15cb-43b8-bcf0-26e27655413a", "name": "network-vif-plugged", "status": "completed", "tag": "3a81e763-66f0-4256-8dff-721180b77137"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:20:48.523399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:48.527768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-6aad7f52-5d7d-46e0-897e-413259b88132 req-69281236-0bcd-47dd-8947-7a6c51a008ae service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:48.528640 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-6aad7f52-5d7d-46e0-897e-413259b88132 req-69281236-0bcd-47dd-8947-7a6c51a008ae service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:48.529209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-6aad7f52-5d7d-46e0-897e-413259b88132 req-69281236-0bcd-47dd-8947-7a6c51a008ae service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:48.534782 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c9a9cecd-ddae-48bf-9ef8-7783806b71d4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.169817 Aug 29 23:20:48.536115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1709/3523] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:48 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:20:48.548343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-6aad7f52-5d7d-46e0-897e-413259b88132 req-69281236-0bcd-47dd-8947-7a6c51a008ae service nova] Creating event network-vif-plugged:3a81e763-66f0-4256-8dff-721180b77137 for instance 02641e15-15cb-43b8-bcf0-26e27655413a on hv-cinder-85426 Aug 29 23:20:48.553408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-6aad7f52-5d7d-46e0-897e-413259b88132 req-69281236-0bcd-47dd-8947-7a6c51a008ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190682 Aug 29 23:20:48.554001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1815/3524] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:20:49.556336 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:49.557477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:49.564885 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:49.565364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:49.565794 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:49.566484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:49.567047 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:49.567544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:49.706141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:49.713683 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-2e10071b-39da-4ad4-b0d4-f88fc534bacc tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1359 microversion: 2.1 time: 0.161408 Aug 29 23:20:49.714251 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1710/3525] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:49 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:50.737216 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:50.737946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:50.748613 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:50.749271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:50.750843 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:50.751618 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:50.752158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:50.752652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:50.910086 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:50.917237 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-eb1e5b74-3830-4db9-bf29-da8e0c8a733a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1549 microversion: 2.1 time: 0.184749 Aug 29 23:20:50.926754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1816/3526] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:50 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:50.938853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:50.950651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:50.950651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:50.950651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:50.950651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:50.951030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:50.951030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:50.951030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:51.089373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:51.097304 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-64ad0c8e-f520-4bfd-b56a-f55602f571e1 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1549 microversion: 2.1 time: 0.163435 Aug 29 23:20:51.097884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1711/3527] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:50 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:51.117508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:51.123064 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:51.123823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Searching by: {'deleted': False, 'project_id': '8b61dd30bd20426990ed70288f69e40b'} {{(pid=128150) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 23:20:51.130307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:51.130783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:51.131344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:51.131921 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:51.132394 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:51.132816 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:51.220664 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.multi_cell_list [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128150) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 23:20:51.314271 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c99a91ff-dd99-4cdc-a81c-2d5cf1a55ae3 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200475 Aug 29 23:20:51.314840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1817/3528] 10.222.0.59 () {58 vars in 1125 bytes} [Mon Aug 29 23:20:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:20:51.326070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:51.326793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:51.332838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:51.333323 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:51.333762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:51.334445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:51.334909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:51.335341 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:51.466967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:51.474626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-08cdb181-4982-4384-ad6f-97b5320960e4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1549 microversion: 2.1 time: 0.152351 Aug 29 23:20:51.475139 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1712/3529] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:51 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:54.823295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1539826793", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452"}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:20:54.831364 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:20:54.831508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:20:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Aug 29 23:20:54.832685 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:54.878355 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] validate_networks() for None {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:20:55.152650 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:20:55.153072 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:20:55.154555 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:20:55.155010 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:20:55.155472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:20:55.164967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:55.165557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:55.165990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:55.166751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:55.167261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:55.167728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:55.187163 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Getting quotas for project 4f7c1328f2744afdb9241fb7b5d959fd. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:20:55.191599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Getting quotas for user 56cb8f5762a64017ae2b74147fb892cf and project 4f7c1328f2744afdb9241fb7b5d959fd. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:20:55.203088 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:20:55.205369 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:20:55.321604 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-51c9bb64-4c0d-48c6-a1de-ef98f1cc0cc7 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502136 Aug 29 23:20:55.322320 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1818/3530] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 23:20:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:20:55.336164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d26f7221-25ec-4d41-b14a-d3e605fd664b tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:55.339648 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d26f7221-25ec-4d41-b14a-d3e605fd664b tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:55.342838 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:20:55.342977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:20:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 (ip 10.222.0.59) !!! Aug 29 23:20:55.345490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:55.413457 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-d26f7221-25ec-4d41-b14a-d3e605fd664b tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:55.421322 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d26f7221-25ec-4d41-b14a-d3e605fd664b tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1215 microversion: 2.1 time: 0.091202 Aug 29 23:20:55.422179 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1713/3531] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:55 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:55.518212 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-19403cde-4c34-4577-9ae1-caace4978d55 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7071f8a7-1e6b-4c46-abfb-628b5deb2891"}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:20:55.520719 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-19403cde-4c34-4577-9ae1-caace4978d55 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:55.528445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19403cde-4c34-4577-9ae1-caace4978d55 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:55.529129 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19403cde-4c34-4577-9ae1-caace4978d55 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:55.529741 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19403cde-4c34-4577-9ae1-caace4978d55 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:55.530513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19403cde-4c34-4577-9ae1-caace4978d55 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:55.530968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19403cde-4c34-4577-9ae1-caace4978d55 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:55.531388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-19403cde-4c34-4577-9ae1-caace4978d55 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:56.203199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:56.376304 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-19403cde-4c34-4577-9ae1-caace4978d55 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "POST /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.861932 Aug 29 23:20:56.382372 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1819/3532] 10.222.0.59 () {60 vars in 1323 bytes} [Mon Aug 29 23:20:55 2022] POST /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments => generated 194 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:20:56.441795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3a0725b2-8fa1-4b8e-ad86-8d314698a8f3 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:56.442400 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3a0725b2-8fa1-4b8e-ad86-8d314698a8f3 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:56.496988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3a0725b2-8fa1-4b8e-ad86-8d314698a8f3 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:56.504106 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3a0725b2-8fa1-4b8e-ad86-8d314698a8f3 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1215 microversion: 2.1 time: 0.066181 Aug 29 23:20:56.504921 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1714/3533] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:56 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:57.526184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:57.526939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:57.533276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:57.533749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:57.534179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:57.534851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:57.535298 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:57.535715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:57.603759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:57.611982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-022457fb-93f9-4366-a7b3-1e9c75237758 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1267 microversion: 2.1 time: 0.090365 Aug 29 23:20:57.612603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1820/3534] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:57 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:58.633256 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:58.633898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:58.640965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:58.641373 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:58.641813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:58.642493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:58.642941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:58.643364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:58.647235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=87 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:58.708979 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:58.717307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-da6db3bf-4e97-4013-8cd3-0bd24de4df83 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1273 microversion: 2.1 time: 0.087880 Aug 29 23:20:58.717992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1715/3535] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:58 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:20:59.638449 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-874e84c1-2182-4c94-bd50-f9c69b92609d req-38e56290-2703-45fd-860f-5fa7255948c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51", "tag": "9cd16a3d-1c96-46ad-a0c7-497249924b25"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:20:59.648550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-874e84c1-2182-4c94-bd50-f9c69b92609d req-38e56290-2703-45fd-860f-5fa7255948c7 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:59.649033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-874e84c1-2182-4c94-bd50-f9c69b92609d req-38e56290-2703-45fd-860f-5fa7255948c7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:59.649471 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-874e84c1-2182-4c94-bd50-f9c69b92609d req-38e56290-2703-45fd-860f-5fa7255948c7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:59.662020 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-874e84c1-2182-4c94-bd50-f9c69b92609d req-38e56290-2703-45fd-860f-5fa7255948c7 service nova] Creating event network-changed:9cd16a3d-1c96-46ad-a0c7-497249924b25 for instance aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 on hv-cinder-85426 Aug 29 23:20:59.668311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-874e84c1-2182-4c94-bd50-f9c69b92609d req-38e56290-2703-45fd-860f-5fa7255948c7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033214 Aug 29 23:20:59.669244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1821/3536] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:20:59.738694 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:20:59.743687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:20:59.746690 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:59.747871 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:59.748487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:59.749170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:20:59.749634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:20:59.750048 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:20:59.890254 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:20:59.898865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-eb1041d1-42b8-4659-859c-cf1f54b793f9 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1315 microversion: 2.1 time: 0.164445 Aug 29 23:20:59.899450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1716/3537] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:20:59 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:00.924291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:00.924291 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:00.928557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:00.929037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:00.929469 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:00.930153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:00.930600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:00.931076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:01.064302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:01.071936 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-70d60c31-ce17-4e39-b1c5-3d75602a23be tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1315 microversion: 2.1 time: 0.155531 Aug 29 23:21:01.072531 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1822/3538] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:00 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:02.093191 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:02.093831 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:02.100413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:02.100899 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:02.101334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:02.102026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:02.102477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:02.102900 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:02.239792 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:02.248821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-80ea7057-c514-41a9-833d-8d76a241b700 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1315 microversion: 2.1 time: 0.159842 Aug 29 23:21:02.249545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1717/3539] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:02 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:03.270035 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:03.270800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:03.277659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:03.277659 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:03.278340 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:03.279771 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:03.280242 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:03.280713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:03.421519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:03.429423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-18064ba0-6fa5-4b9d-8691-d73a799bdc15 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1315 microversion: 2.1 time: 0.163162 Aug 29 23:21:03.430033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1823/3540] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:03 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:04.372744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-403e2cc4-e3fd-4403-9a42-a8304f354db4 req-cc846b6b-1d89-4f56-8d07-c2ffae4cb11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51", "name": "network-vif-plugged", "status": "completed", "tag": "9cd16a3d-1c96-46ad-a0c7-497249924b25"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:04.382606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-403e2cc4-e3fd-4403-9a42-a8304f354db4 req-cc846b6b-1d89-4f56-8d07-c2ffae4cb11e service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:04.383072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-403e2cc4-e3fd-4403-9a42-a8304f354db4 req-cc846b6b-1d89-4f56-8d07-c2ffae4cb11e service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:04.383493 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-403e2cc4-e3fd-4403-9a42-a8304f354db4 req-cc846b6b-1d89-4f56-8d07-c2ffae4cb11e service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:04.394189 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-403e2cc4-e3fd-4403-9a42-a8304f354db4 req-cc846b6b-1d89-4f56-8d07-c2ffae4cb11e service nova] Creating event network-vif-plugged:9cd16a3d-1c96-46ad-a0c7-497249924b25 for instance aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 on hv-cinder-85426 Aug 29 23:21:04.399077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-403e2cc4-e3fd-4403-9a42-a8304f354db4 req-cc846b6b-1d89-4f56-8d07-c2ffae4cb11e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030096 Aug 29 23:21:04.399649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1718/3541] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:04.451110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:04.451628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:04.459990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:04.460594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:04.461033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:04.461917 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:04.462494 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:04.462915 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:04.607363 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:04.617556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-3bba6e36-05d9-4a3c-8df1-54acb78c5dcd tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1315 microversion: 2.1 time: 0.170673 Aug 29 23:21:04.618125 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1824/3542] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:04 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:05.032856 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:05.033888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:05.040332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:05.040813 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:05.041266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:05.042040 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:05.042476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:05.043164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:05.174467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:05.182993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9a81d684-67e0-41e6-8afe-dfd3199e3109 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1595 microversion: 2.1 time: 0.154449 Aug 29 23:21:05.183863 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1719/3543] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:05 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:05.690000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:05.690000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:05.690000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=4 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:21:05.690000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=6 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:21:05.690000 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:05.690814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:05.690814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:05.690814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:05.690814 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:05.691707 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:05.785455 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:05.793382 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-98172fc4-cca5-406a-bbf1-6c68b6ffb828 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1315 microversion: 2.1 time: 0.159869 Aug 29 23:21:05.793934 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1825/3544] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:05 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:06.814877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:06.815399 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:06.817862 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=4 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:21:06.822874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:06.823358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:06.823793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:06.824515 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:06.824968 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:06.825394 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:07.043935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:07.056026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-598151c3-210a-4710-a692-931c288819ac tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1465 microversion: 2.1 time: 0.244945 Aug 29 23:21:07.056795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1720/3545] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:06 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1465 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:07.102344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:07.109197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:07.111113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:07.111603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:07.112045 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:07.112774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:07.113336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:07.113658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:07.139727 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:21:07.376420 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fc131a1c-54ec-4b3b-8e06-2320d160ddf4 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "DELETE /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 204 len: 0 microversion: 2.1 time: 0.277586 Aug 29 23:21:07.377016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1826/3546] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:21:07 2022] DELETE /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:21:07.385283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:07.390119 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:07.393504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:07.394005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:07.394459 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:07.395158 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:07.395627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:07.396054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:07.593517 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:07.601354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f53a1b79-94d5-47da-a459-88fd7ece1a81 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1471 microversion: 2.1 time: 0.219934 Aug 29 23:21:07.601925 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1721/3547] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:07 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:08.364306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-ded056ab-2ab8-429c-a533-51be9ac5ee88 req-1658cc5e-66ea-4acb-a288-46b167c32bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02641e15-15cb-43b8-bcf0-26e27655413a", "tag": "3a81e763-66f0-4256-8dff-721180b77137"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:08.375899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-ded056ab-2ab8-429c-a533-51be9ac5ee88 req-1658cc5e-66ea-4acb-a288-46b167c32bdf service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:08.376711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-ded056ab-2ab8-429c-a533-51be9ac5ee88 req-1658cc5e-66ea-4acb-a288-46b167c32bdf service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:08.377238 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-ded056ab-2ab8-429c-a533-51be9ac5ee88 req-1658cc5e-66ea-4acb-a288-46b167c32bdf service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:08.390065 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-ded056ab-2ab8-429c-a533-51be9ac5ee88 req-1658cc5e-66ea-4acb-a288-46b167c32bdf service nova] Creating event network-changed:3a81e763-66f0-4256-8dff-721180b77137 for instance 02641e15-15cb-43b8-bcf0-26e27655413a on hv-cinder-85426 Aug 29 23:21:08.396026 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-ded056ab-2ab8-429c-a533-51be9ac5ee88 req-1658cc5e-66ea-4acb-a288-46b167c32bdf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035923 Aug 29 23:21:08.396681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1827/3548] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:08.628118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:08.629050 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:08.636172 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:08.636762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:08.637434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:08.638383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:08.639261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:08.640268 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:08.826218 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:08.836628 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9201bffb-74df-44fd-86d7-bd3c19210f3c tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1471 microversion: 2.1 time: 0.216741 Aug 29 23:21:08.839460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1722/3549] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:08 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:09.860963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:09.861658 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:09.868233 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:09.868712 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:09.869147 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:09.869824 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:09.870273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:09.870697 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:09.938338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56cb8f5762a64017ae2b74147fb892cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c1328f2744afdb9241fb7b5d959fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:09.946310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1d090f65-9958-41ca-9681-0e25a9841ef2 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 200 len: 1300 microversion: 2.1 time: 0.089532 Aug 29 23:21:09.946882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1828/3550] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:09 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:10.412524 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-396dccf6-fb98-49fe-ba4d-b4976d5a7661 req-d4df83e2-9259-4b84-a6a1-08235684fc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51", "name": "network-vif-deleted", "tag": "9cd16a3d-1c96-46ad-a0c7-497249924b25"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:10.422472 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-396dccf6-fb98-49fe-ba4d-b4976d5a7661 req-d4df83e2-9259-4b84-a6a1-08235684fc8f service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:10.422954 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-396dccf6-fb98-49fe-ba4d-b4976d5a7661 req-d4df83e2-9259-4b84-a6a1-08235684fc8f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:10.423387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-396dccf6-fb98-49fe-ba4d-b4976d5a7661 req-d4df83e2-9259-4b84-a6a1-08235684fc8f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:10.437178 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-396dccf6-fb98-49fe-ba4d-b4976d5a7661 req-d4df83e2-9259-4b84-a6a1-08235684fc8f service nova] Creating event network-vif-deleted:9cd16a3d-1c96-46ad-a0c7-497249924b25 for instance aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 on hv-cinder-85426 Aug 29 23:21:10.442419 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-396dccf6-fb98-49fe-ba4d-b4976d5a7661 req-d4df83e2-9259-4b84-a6a1-08235684fc8f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033659 Aug 29 23:21:10.448632 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1723/3551] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:10.969589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:10.969589 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] [instance: aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:10.974759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:10.975417 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:10.975890 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:10.976607 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:10.977059 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:10.977475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:10.995278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] HTTP exception thrown: Instance aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 could not be found. Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Request method failure captured: Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 HTTP/1.1 Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUnSI5tS2U-wM9ro9QHdPQs0brHT1BN-h2gUKUt7ZFikjGUpoM0mbiXuSXE204BDUu8HkgsIKwJE1u0obC4mab7hHJViRkBhestnbfPJBJUBbUBCSfL5pgoZa27q0mueUG135X7naqOQ0Zz_B2pc-yEZFgEFlTYBqJjIsObgAAIjb04 Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 4f7c1328f2744afdb9241fb7b5d959fd Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-VolumesNegativeTest-858520919 Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:21:10.997093 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f7c1328f2744afdb9241fb7b5d959fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f7c1328f2744afdb9241fb7b5d959fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f7c1328f2744afdb9241fb7b5d959fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f7c1328f2744afdb9241fb7b5d959fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-VolumesNegativeTest-858520919 Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 4f7c1328f2744afdb9241fb7b5d959fd Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-VolumesNegativeTest-858520919 Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-VolumesNegativeTest-858520919-project Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 56cb8f5762a64017ae2b74147fb892cf Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-VolumesNegativeTest-858520919-project Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 could not be found. Aug 29 23:21:10.999798 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': 'aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51'} Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 could not be found. Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:21:11.000796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 could not be found. Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 could not be found. Aug 29 23:21:11.002015 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:11.003131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] Returning 404 to user: Instance aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:21:11.003131 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bfad91b9-a50b-466d-8e6b-3b1813103b60 tempest-VolumesNegativeTest-858520919 tempest-VolumesNegativeTest-858520919-project] 10.222.0.59 "GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51" status: 404 len: 111 microversion: 2.1 time: 0.035368 Aug 29 23:21:11.004496 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1829/3552] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:10 2022] GET /compute/v2.1/servers/aa7c08f3-5da9-4a1a-bc9f-448efb8b8e51 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:21:11.457987 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-751145886"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:11.458491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:11.464643 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:11.465126 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:11.465563 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:11.466249 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:11.466710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:11.467163 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:11.605933 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.network.security_group_api [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Adding security group ba9eff85-a177-4b26-bcf9-5d17e6691e42 to port 3a81e763-66f0-4256-8dff-721180b77137 Aug 29 23:21:12.036226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ccf2b498-afe7-49ae-8ef6-4d749c608dfe tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "POST /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/action" status: 202 len: 0 microversion: 2.1 time: 0.582059 Aug 29 23:21:12.036946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1724/3553] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 23:21:11 2022] POST /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:21:12.055182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:12.056438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:12.063264 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:12.063774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:12.064223 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:12.065068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:12.065514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:12.065929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:12.234167 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:12.243055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-575dacee-8c01-45a4-9ffe-7d3f85dd3182 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1760 microversion: 2.1 time: 0.191647 Aug 29 23:21:12.253158 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1830/3554] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:12 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1760 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:12.465935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-e1d52761-25b6-4a19-aca0-736cbcf96f99 req-1de2675d-2a85-4fda-807c-e32ec5ba273c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02641e15-15cb-43b8-bcf0-26e27655413a", "tag": "3a81e763-66f0-4256-8dff-721180b77137"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:12.477908 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-e1d52761-25b6-4a19-aca0-736cbcf96f99 req-1de2675d-2a85-4fda-807c-e32ec5ba273c service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:12.478391 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-e1d52761-25b6-4a19-aca0-736cbcf96f99 req-1de2675d-2a85-4fda-807c-e32ec5ba273c service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:12.478860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-e1d52761-25b6-4a19-aca0-736cbcf96f99 req-1de2675d-2a85-4fda-807c-e32ec5ba273c service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:12.491099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-e1d52761-25b6-4a19-aca0-736cbcf96f99 req-1de2675d-2a85-4fda-807c-e32ec5ba273c service nova] Creating event network-changed:3a81e763-66f0-4256-8dff-721180b77137 for instance 02641e15-15cb-43b8-bcf0-26e27655413a on hv-cinder-85426 Aug 29 23:21:12.499553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-e1d52761-25b6-4a19-aca0-736cbcf96f99 req-1de2675d-2a85-4fda-807c-e32ec5ba273c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038582 Aug 29 23:21:12.499553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1725/3555] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:20.530243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:20.534171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:20.541686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:20.542171 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:20.542608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:20.543294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:20.543777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:20.544225 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:20.558576 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 HTTP/1.1 Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:21:20.560206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.561318 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '50bc49c0-59c8-4adc-9c9a-a43adb38c922'} Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:21:20.562070 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.563027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.564095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:21:20.564095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9b436b40-a823-4e94-89b7-11b8c97236c2 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "DELETE /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 404 len: 111 microversion: 2.1 time: 0.035733 Aug 29 23:21:20.564095 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1831/3556] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:21:20 2022] DELETE /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:21:20.572320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:20.573016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] [instance: 50bc49c0-59c8-4adc-9c9a-a43adb38c922] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:20.579067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:20.579545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:20.579975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:20.580679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:20.581122 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:20.582402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:20.595440 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] HTTP exception thrown: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Request method failure captured: Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 HTTP/1.1 Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUGIi3nPWpOos7SWzUOaEucq3rslDq5_3u2HOOM8yvDIC5qrU7g3oq8Hm_BZv31_1eMs6EDrbfyMGVGYsiQQpVi335GCoIlhB-fwh0vwUEti8k7UQ32doFvIeEVXZpWyeEiTq_5TFz1cdbPKEGg1Mv1kUhltGit5AFWu5-GsiCMecxk Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:21:20.597111 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a826c462a3fa429eb866d354afcbe950", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a826c462a3fa429eb866d354afcbe950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: a826c462a3fa429eb866d354afcbe950 Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-399164251 Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 9c2fdfdb62b54f05b7d81f14ec197cca Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-AttachVolumeNegativeTest-399164251-project Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.599276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '50bc49c0-59c8-4adc-9c9a-a43adb38c922'} Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:21:20.600006 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. Aug 29 23:21:20.605149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:20.606216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] Returning 404 to user: Instance 50bc49c0-59c8-4adc-9c9a-a43adb38c922 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:21:20.606216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-223a4db2-9896-42e7-b604-14818ba53bd6 tempest-AttachVolumeNegativeTest-399164251 tempest-AttachVolumeNegativeTest-399164251-project] 10.222.0.59 "GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922" status: 404 len: 111 microversion: 2.1 time: 0.031837 Aug 29 23:21:20.606216 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1726/3557] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:20 2022] GET /compute/v2.1/servers/50bc49c0-59c8-4adc-9c9a-a43adb38c922 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:21:30.316967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e0503c57-bdfc-4b34-9f2d-ec7a91ee9173 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd89a20d0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:30.371877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e0503c57-bdfc-4b34-9f2d-ec7a91ee9173 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c1a7097b-e35b-4ccc-81ad-6f338b577984" status: 200 len: 351 microversion: 2.1 time: 0.059525 Aug 29 23:21:30.372483 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1832/3558] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 23:21:30 2022] GET /compute/v2.1/os-volumes/c1a7097b-e35b-4ccc-81ad-6f338b577984 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:31.799735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ae8ec298-3760-4253-83f6-63b32b881a9b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:31.802764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ae8ec298-3760-4253-83f6-63b32b881a9b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:31.810851 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=31 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:21:31.812491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=53 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:21:31.814483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae8ec298-3760-4253-83f6-63b32b881a9b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:31.815177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae8ec298-3760-4253-83f6-63b32b881a9b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:31.815836 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae8ec298-3760-4253-83f6-63b32b881a9b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:31.817054 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae8ec298-3760-4253-83f6-63b32b881a9b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:31.817886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae8ec298-3760-4253-83f6-63b32b881a9b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:31.818552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ae8ec298-3760-4253-83f6-63b32b881a9b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:32.061861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ae8ec298-3760-4253-83f6-63b32b881a9b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "POST /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/action" status: 202 len: 0 microversion: 2.1 time: 0.265753 Aug 29 23:21:32.065491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1727/3559] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 23:21:31 2022] POST /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:21:32.068554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:21:32.069334 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=66,nova_cell1:INSERT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:21:32.075713 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:32.076447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:32.086781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:32.087527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:32.088211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:32.089100 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:32.089570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:32.090002 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:32.184749 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d0d46d4c-7eaa-49dd-8ebb-e1457bd715a0 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd4fc2940>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:32.262590 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d0d46d4c-7eaa-49dd-8ebb-e1457bd715a0 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/9e18ad23-78b3-4efe-ad52-894a5ff34200" status: 200 len: 351 microversion: 2.1 time: 0.081934 Aug 29 23:21:32.271998 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1728/3560] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 23:21:32 2022] GET /compute/v2.1/os-volumes/9e18ad23-78b3-4efe-ad52-894a5ff34200 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:32.397605 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:32.414581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-469469d3-2043-4053-9fad-d05918c04f36 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1752 microversion: 2.1 time: 0.347286 Aug 29 23:21:32.415700 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1833/3561] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:32 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1752 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:33.438023 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:33.438741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:33.447175 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:33.447657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:33.448087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:33.449064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:33.449584 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:33.450063 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:33.614723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:33.622869 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9a8d1abe-9922-46e3-a630-09bf42dbd5a6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.189738 Aug 29 23:21:33.623430 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1729/3562] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:33 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:33.703677 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-24c31414-2743-4da3-ba67-87906a6a7710 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Action: 'create', calling method: .version_select at 0x7febd52cf3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-826589568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkzNbmlvv1UekFcvoPiHnmtHnnt6xSSbqb+p4ukLXe8CDuX2OAwT2X/ho8vEkDyY25xoe1nRzGTjEdGgsHytM2K/Dbg/jbhEy4Zc4y0f79HrtYg1d2zG76t10U4yvwx9Q=="}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:33.720077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-24c31414-2743-4da3-ba67-87906a6a7710 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Getting quotas for project fc6b1df0e5104fd6abb5dcf5497d2cb1. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:21:33.724948 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-24c31414-2743-4da3-ba67-87906a6a7710 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Getting quotas for user d3acbdab00c64d84871545062a5b5311 and project fc6b1df0e5104fd6abb5dcf5497d2cb1. Resources: {'key_pairs'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:21:33.818728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-24c31414-2743-4da3-ba67-87906a6a7710 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.291584 Aug 29 23:21:33.819309 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1834/3563] 10.222.0.59 () {60 vars in 1159 bytes} [Mon Aug 29 23:21:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:21:34.076085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b320df1d-e6fd-400c-a71a-159ba1366e40 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd4fc28b0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:34.157421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b320df1d-e6fd-400c-a71a-159ba1366e40 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f44e7c2f-8be5-4601-849c-7ad18a9fca56" status: 200 len: 351 microversion: 2.1 time: 0.085329 Aug 29 23:21:34.158199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1730/3564] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 23:21:34 2022] GET /compute/v2.1/os-volumes/f44e7c2f-8be5-4601-849c-7ad18a9fca56 => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:34.171553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5683870c-8730-4e1c-bd37-6451bba5a2fb tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd503e310>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:34.267135 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5683870c-8730-4e1c-bd37-6451bba5a2fb tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.099334 Aug 29 23:21:34.267772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1835/3565] 10.222.0.59 () {58 vars in 1134 bytes} [Mon Aug 29 23:21:34 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:34.282345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6d4cbec2-7545-4e84-9289-d457f5a35343 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd4ff6e50>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:34.368909 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6d4cbec2-7545-4e84-9289-d457f5a35343 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090636 Aug 29 23:21:34.369487 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1731/3566] 10.222.0.59 () {58 vars in 1149 bytes} [Mon Aug 29 23:21:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:34.383529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-09d205fb-6a40-4cd0-94f9-024475a143e5 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd5016d30>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:34.648831 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-09d205fb-6a40-4cd0-94f9-024475a143e5 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.269660 Aug 29 23:21:34.649875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1836/3567] 10.222.0.59 () {58 vars in 1134 bytes} [Mon Aug 29 23:21:34 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:34.651242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:34.651938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:34.662859 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-54cf7dec-ec18-420f-9e6b-5eadb445a599 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd500a1f0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:34.670842 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:34.671340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:34.671774 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:34.674706 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:34.675165 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:34.678115 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:34.778184 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-54cf7dec-ec18-420f-9e6b-5eadb445a599 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.119845 Aug 29 23:21:34.779390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1837/3568] 10.222.0.59 () {58 vars in 1167 bytes} [Mon Aug 29 23:21:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:34.793594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b03c8112-4fdd-4cc4-954b-dae28f15f72e tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd509ac10>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:34.855085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:34.869110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8c25f062-3578-40b6-b977-3b76a18a0860 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.226594 Aug 29 23:21:34.871232 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1732/3569] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:34 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:21:34.889774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b03c8112-4fdd-4cc4-954b-dae28f15f72e tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096975 Aug 29 23:21:34.889774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1838/3570] 10.222.0.59 () {58 vars in 1170 bytes} [Mon Aug 29 23:21:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:21:34.901952 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-68a3e289-d8e3-4bda-84ff-cfb87d665a63 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd4ff6430>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:35.174788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-68a3e289-d8e3-4bda-84ff-cfb87d665a63 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.276652 Aug 29 23:21:35.179396 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1733/3571] 10.222.0.59 () {58 vars in 1155 bytes} [Mon Aug 29 23:21:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:35.191902 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a0bba2af-e5be-4b0e-b4ac-197543bc7bb1 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd50d0040>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:35.276583 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a0bba2af-e5be-4b0e-b4ac-197543bc7bb1 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088926 Aug 29 23:21:35.277156 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1839/3572] 10.222.0.59 () {58 vars in 1188 bytes} [Mon Aug 29 23:21:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:35.290993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0715086a-d97b-4386-9a77-2d19eb329477 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] Calling method '.version_select at 0x7febd518aee0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:35.377087 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0715086a-d97b-4386-9a77-2d19eb329477 tempest-VolumesTestJSON-1148609080 tempest-VolumesTestJSON-1148609080-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.090444 Aug 29 23:21:35.377664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1734/3573] 10.222.0.59 () {58 vars in 1155 bytes} [Mon Aug 29 23:21:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:35.893080 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:35.893914 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:35.910966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:35.911459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:35.911899 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:35.912856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:35.913608 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:35.921538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:36.092793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:36.102370 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9dff3eb7-7474-4a57-a930-f7daeb75e0b9 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.214120 Aug 29 23:21:36.102951 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1840/3574] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:35 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:37.124145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:37.126014 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:37.132018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:37.132542 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:37.132977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:37.133828 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:37.134438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:37.135028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:37.283308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:37.293099 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3583ddbe-1676-4da1-bed3-676ef6012f4c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.174126 Aug 29 23:21:37.293765 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1735/3575] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:37 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:38.318967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:38.318967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:38.323937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:38.324459 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:38.324940 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:38.325732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:38.326221 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:38.326751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:38.474781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:38.484389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7bc0a1c4-0f8b-4337-a1bc-be937d88cc6c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.173022 Aug 29 23:21:38.484985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1841/3576] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:38 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:39.506454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:39.507405 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:39.513599 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:39.514109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:39.514505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:39.515185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:39.515627 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:39.516039 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:39.665272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:39.673958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef25ae6d-3b3a-4f2d-8f5a-72117d90387a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.171460 Aug 29 23:21:39.674629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1736/3577] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:39 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:40.694699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:40.696107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:40.703331 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:40.704113 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:40.704579 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:40.705276 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:40.705732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:40.706157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:40.852121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:40.862323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-e80fc294-d2cb-410f-8060-36cdf905acf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.169412 Aug 29 23:21:40.862323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1842/3578] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:40 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:41.465057 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac32c850-2ee3-4862-925f-70897b83cb52 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Action: 'create', calling method: .version_select at 0x7febd89dc4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1185930965", "metadata": {"Type": "work"}}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac32c850-2ee3-4862-925f-70897b83cb52 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Request method failure captured: Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 122 Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUoFa6HqbDVA2MJXBzJ6TkX7Db1ep5magPaLRr5PPPolWCA-uRgAdiK87nNz9HOmle2xjS3_PpLbCpfe1o-iEzqosejsXZWbmrsC1nZN6u5YQL9TzBbM_bvgKmCYz1TwBRKq-Gc-ZtJEbvgY5oxpzoQ4pnukRPb6l3TCgOU-3NUo1wk Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:21:41.477882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1649b11f458141f8b47bbf42eb19e876", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 86d4d3fb610842ad9ac1a12e5248d7c1 Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1185930965", "metadata": {"Type": "work"}}} Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: Aug 29 23:21:41.479303 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1185930965', 'metadata': {'Type': 'work'}}}} Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise error Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:21:41.480222 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 23:21:41.481478 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 23:21:41.482518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 23:21:41.482518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.482518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ac32c850-2ee3-4862-925f-70897b83cb52 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:21:41.482518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ac32c850-2ee3-4862-925f-70897b83cb52 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132203 Aug 29 23:21:41.482518 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1737/3579] 10.222.0.59 () {60 vars in 1156 bytes} [Mon Aug 29 23:21:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:21:41.488916 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-254dea5b-ced3-4f24-bafa-4d96415b510d tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Action: 'create', calling method: .version_select at 0x7febd89a2790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-215440453", "metadata": {"Type": "work"}}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-254dea5b-ced3-4f24-bafa-4d96415b510d tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Request method failure captured: Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 119 Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUoFa6HqbDVA2MJXBzJ6TkX7Db1ep5magPaLRr5PPPolWCA-uRgAdiK87nNz9HOmle2xjS3_PpLbCpfe1o-iEzqosejsXZWbmrsC1nZN6u5YQL9TzBbM_bvgKmCYz1TwBRKq-Gc-ZtJEbvgY5oxpzoQ4pnukRPb6l3TCgOU-3NUo1wk Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:21:41.493699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1649b11f458141f8b47bbf42eb19e876", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 86d4d3fb610842ad9ac1a12e5248d7c1 Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-215440453", "metadata": {"Type": "work"}}} Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: Aug 29 23:21:41.495057 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-215440453', 'metadata': {'Type': 'work'}}}} Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise error Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi '0' Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:21:41.495851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 23:21:41.501525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 23:21:41.502615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 23:21:41.502615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.502615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-254dea5b-ced3-4f24-bafa-4d96415b510d tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:21:41.502615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-254dea5b-ced3-4f24-bafa-4d96415b510d tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010001 Aug 29 23:21:41.502615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1843/3580] 10.222.0.59 () {60 vars in 1156 bytes} [Mon Aug 29 23:21:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 23:21:41.508743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9a722748-ee9d-4345-84b1-fe74fb43ab14 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Action: 'create', calling method: .version_select at 0x7febd4faa820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-330580723", "metadata": {"Type": "work"}}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9a722748-ee9d-4345-84b1-fe74fb43ab14 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Request method failure captured: Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 118 Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUoFa6HqbDVA2MJXBzJ6TkX7Db1ep5magPaLRr5PPPolWCA-uRgAdiK87nNz9HOmle2xjS3_PpLbCpfe1o-iEzqosejsXZWbmrsC1nZN6u5YQL9TzBbM_bvgKmCYz1TwBRKq-Gc-ZtJEbvgY5oxpzoQ4pnukRPb6l3TCgOU-3NUo1wk Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:21:41.513064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1649b11f458141f8b47bbf42eb19e876", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 86d4d3fb610842ad9ac1a12e5248d7c1 Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-330580723", "metadata": {"Type": "work"}}} Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: Aug 29 23:21:41.514489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-330580723', 'metadata': {'Type': 'work'}}}} Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise error Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi '' Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:21:41.515340 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 23:21:41.516780 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 23:21:41.517796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 23:21:41.517796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.517796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-9a722748-ee9d-4345-84b1-fe74fb43ab14 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:21:41.517796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-9a722748-ee9d-4345-84b1-fe74fb43ab14 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009534 Aug 29 23:21:41.517796 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1738/3581] 10.222.0.59 () {60 vars in 1156 bytes} [Mon Aug 29 23:21:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:21:41.523178 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c6ccc36a-bbbf-4bb3-889a-6da558b3ca5b tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Calling method '.version_select at 0x7febd503e0d0>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:41.552058 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-c6ccc36a-bbbf-4bb3-889a-6da558b3ca5b tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] HTTP exception thrown: Volume tempest-invalid-1613515393 could not be found. Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c6ccc36a-bbbf-4bb3-889a-6da558b3ca5b tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Request method failure captured: Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1613515393 HTTP/1.1 Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUoFa6HqbDVA2MJXBzJ6TkX7Db1ep5magPaLRr5PPPolWCA-uRgAdiK87nNz9HOmle2xjS3_PpLbCpfe1o-iEzqosejsXZWbmrsC1nZN6u5YQL9TzBbM_bvgKmCYz1TwBRKq-Gc-ZtJEbvgY5oxpzoQ4pnukRPb6l3TCgOU-3NUo1wk Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:21:41.554764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1649b11f458141f8b47bbf42eb19e876", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 86d4d3fb610842ad9ac1a12e5248d7c1 Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Volume tempest-invalid-1613515393 could not be found. Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': 'tempest-invalid-1613515393'} Aug 29 23:21:41.556121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1613515393 could not be found. (HTTP 404) (Request-ID: req-5ee58656-f9ce-43f6-90fb-a21284cd27c1) Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.557164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:21:41.558492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1613515393 could not be found. Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:21:41.559974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1613515393 could not be found. Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1613515393 could not be found. Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c6ccc36a-bbbf-4bb3-889a-6da558b3ca5b tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Returning 404 to user: Volume tempest-invalid-1613515393 could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c6ccc36a-bbbf-4bb3-889a-6da558b3ca5b tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1613515393" status: 404 len: 99 microversion: 2.1 time: 0.036778 Aug 29 23:21:41.561294 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1844/3582] 10.222.0.59 () {58 vars in 1218 bytes} [Mon Aug 29 23:21:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1613515393 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 23:21:41.565629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5d9717c2-dc08-4abd-8458-ae97d570f31c tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003659 Aug 29 23:21:41.566125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1739/3583] 10.222.0.59 () {58 vars in 1140 bytes} [Mon Aug 29 23:21:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 23:21:41.575458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f8a4f250-515f-41bf-bb9c-ace87d2dd15a tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004425 Aug 29 23:21:41.576206 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1845/3584] 10.222.0.59 () {58 vars in 1137 bytes} [Mon Aug 29 23:21:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 23:21:41.587058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8a86300b-3dee-4a0b-8a4f-23b08ce6a6ef tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Calling method '.version_select at 0x7febd4fce9d0>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:41.614916 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-8a86300b-3dee-4a0b-8a4f-23b08ce6a6ef tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] HTTP exception thrown: Volume 63cda87f-0c73-46ec-bbcd-2352778aecb5 could not be found. Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8a86300b-3dee-4a0b-8a4f-23b08ce6a6ef tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Request method failure captured: Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: DELETE /compute/v2.1/os-volumes/63cda87f-0c73-46ec-bbcd-2352778aecb5 HTTP/1.1 Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUoFa6HqbDVA2MJXBzJ6TkX7Db1ep5magPaLRr5PPPolWCA-uRgAdiK87nNz9HOmle2xjS3_PpLbCpfe1o-iEzqosejsXZWbmrsC1nZN6u5YQL9TzBbM_bvgKmCYz1TwBRKq-Gc-ZtJEbvgY5oxpzoQ4pnukRPb6l3TCgOU-3NUo1wk Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:21:41.616858 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1649b11f458141f8b47bbf42eb19e876", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 86d4d3fb610842ad9ac1a12e5248d7c1 Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Volume 63cda87f-0c73-46ec-bbcd-2352778aecb5 could not be found. Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '63cda87f-0c73-46ec-bbcd-2352778aecb5'} Aug 29 23:21:41.618710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63cda87f-0c73-46ec-bbcd-2352778aecb5 could not be found. (HTTP 404) (Request-ID: req-df1b4407-631d-43f9-9355-645e21ae68b5) Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.619536 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:21:41.620629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63cda87f-0c73-46ec-bbcd-2352778aecb5 could not be found. Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 23:21:41.621559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63cda87f-0c73-46ec-bbcd-2352778aecb5 could not be found. Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63cda87f-0c73-46ec-bbcd-2352778aecb5 could not be found. Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8a86300b-3dee-4a0b-8a4f-23b08ce6a6ef tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Returning 404 to user: Volume 63cda87f-0c73-46ec-bbcd-2352778aecb5 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8a86300b-3dee-4a0b-8a4f-23b08ce6a6ef tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/63cda87f-0c73-46ec-bbcd-2352778aecb5" status: 404 len: 109 microversion: 2.1 time: 0.037005 Aug 29 23:21:41.622580 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1740/3585] 10.222.0.59 () {58 vars in 1248 bytes} [Mon Aug 29 23:21:41 2022] DELETE /compute/v2.1/os-volumes/63cda87f-0c73-46ec-bbcd-2352778aecb5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:21:41.627689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d3b28763-417b-43bd-a64b-eb2f832dbb16 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Calling method '.version_select at 0x7febd5dbd820>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:41.655796 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-d3b28763-417b-43bd-a64b-eb2f832dbb16 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] HTTP exception thrown: Volume c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc could not be found. Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d3b28763-417b-43bd-a64b-eb2f832dbb16 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Request method failure captured: Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/os-volumes/c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc HTTP/1.1 Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUoFa6HqbDVA2MJXBzJ6TkX7Db1ep5magPaLRr5PPPolWCA-uRgAdiK87nNz9HOmle2xjS3_PpLbCpfe1o-iEzqosejsXZWbmrsC1nZN6u5YQL9TzBbM_bvgKmCYz1TwBRKq-Gc-ZtJEbvgY5oxpzoQ4pnukRPb6l3TCgOU-3NUo1wk Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:21:41.657749 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1649b11f458141f8b47bbf42eb19e876", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1649b11f458141f8b47bbf42eb19e876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 1649b11f458141f8b47bbf42eb19e876 Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-VolumesNegativeTest-1536441808 Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 86d4d3fb610842ad9ac1a12e5248d7c1 Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-VolumesNegativeTest-1536441808-project Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Volume c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc could not be found. Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': 'c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc'} Aug 29 23:21:41.659230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc could not be found. (HTTP 404) (Request-ID: req-848da27b-4652-4a3e-b1d5-ff8d072ef898) Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.660586 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:21:41.661860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc could not be found. Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 23:21:41.663428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc could not be found. Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc could not be found. Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d3b28763-417b-43bd-a64b-eb2f832dbb16 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] Returning 404 to user: Volume c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d3b28763-417b-43bd-a64b-eb2f832dbb16 tempest-VolumesNegativeTest-1536441808 tempest-VolumesNegativeTest-1536441808-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc" status: 404 len: 109 microversion: 2.1 time: 0.037393 Aug 29 23:21:41.665680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1846/3586] 10.222.0.59 () {58 vars in 1245 bytes} [Mon Aug 29 23:21:41 2022] GET /compute/v2.1/os-volumes/c1e1e1ee-ffcb-4d4e-a754-ca14acffa4dc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:21:41.883720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:41.884579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:41.891086 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:41.896094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:41.896094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:41.896094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:41.896094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:41.896451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:42.041489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:42.049790 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-5a8a6560-5a82-4d8c-9d4d-5bc700d0ddf2 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.171678 Aug 29 23:21:42.050345 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1741/3587] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:41 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:43.073013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:43.074152 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:43.082478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:43.083055 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:43.083570 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:43.084474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:43.085115 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:43.085681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:43.234939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:43.243460 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-713f7ca7-a0b3-40d1-a500-8e2c62ea8582 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.176055 Aug 29 23:21:43.244022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1847/3588] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:43 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:44.264606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:44.265219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:44.271630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:44.272107 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:44.272573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:44.273301 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:44.282074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:44.282074 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:44.434020 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:44.442651 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8371ed30-fc9f-45a2-b01a-387e7c47771c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.182244 Aug 29 23:21:44.443250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1742/3589] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:44 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:45.464630 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:45.465245 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:45.471443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=4 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:21:45.487120 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:45.487761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:45.488219 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:45.489112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:45.491678 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:45.493107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:45.672513 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:45.684008 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d8095a49-cd0f-4c8c-b300-8ad0fbe6ff7e tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.223488 Aug 29 23:21:45.684791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1848/3590] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:45 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:46.705959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:46.706784 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:46.717834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:46.717834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:46.717834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:46.717834 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:46.718272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:46.718272 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:46.873491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:46.881807 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-390bf96e-cb43-4bc4-af90-9c4714001206 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.179712 Aug 29 23:21:46.887554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1743/3591] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:46 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:47.902793 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:47.903337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:47.910005 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:47.910490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:47.910931 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:47.911617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:47.912074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:47.912527 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:48.066438 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:48.074773 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-06c272cc-5417-45c8-9df7-e83f86767711 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.175952 Aug 29 23:21:48.075346 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1849/3592] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:47 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:49.095889 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:49.096526 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:49.102879 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:49.103350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:49.108644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:49.108644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:49.108644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:49.108644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:49.251761 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:49.260696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1e729710-dad6-4499-bdfe-6449df890439 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1757 microversion: 2.1 time: 0.168766 Aug 29 23:21:49.261262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1744/3593] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:49 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:50.283040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:50.283544 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:50.290209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:50.290687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:50.291118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:50.291812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:50.292307 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:50.292731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:50.438160 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:50.446250 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-20301d5a-626f-47c2-b5aa-17de68e7ca0a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1760 microversion: 2.1 time: 0.167057 Aug 29 23:21:50.446819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1850/3594] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:50 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:53.266142 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1825004436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-826589568", "security_groups": [{"name": "tempest-secgroup-smoke-746304963"}], "networks": [{"uuid": "ce315842-99c6-495c-b392-2d9325804373"}], "block_device_mapping_v2": [{"uuid": "81613cd5-f646-476f-923b-c7b79f30c9f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:53.376924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.network.neutron [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] validate_networks() for [('ce315842-99c6-495c-b392-2d9325804373', None, None, None, None, None)] {{(pid=128151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:21:53.741676 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Flavor limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:21:53.742094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Image limits 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:21:53.742558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Flavor pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:21:53.742956 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Image pref 0:0:0 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:21:53.743358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.virt.hardware [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:21:53.753758 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:53.754236 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:53.754666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:53.755527 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:53.755977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:53.756424 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:53.773226 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Getting quotas for project fc6b1df0e5104fd6abb5dcf5497d2cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:21:53.777156 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.quota [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Getting quotas for user d3acbdab00c64d84871545062a5b5311 and project fc6b1df0e5104fd6abb5dcf5497d2cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:21:53.835049 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Going to run 1 instances... {{(pid=128151) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:21:53.837321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81613cd5-f646-476f-923b-c7b79f30c9f4',volume_size=None,volume_type=None)] {{(pid=128151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:21:54.233433 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3827c43e-d76f-4504-8411-c73720e4091b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.970964 Aug 29 23:21:54.234005 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1745/3595] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 23:21:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:21:54.244759 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-32750628-2945-4dfb-9502-1b716e67c0d8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:54.245514 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-32750628-2945-4dfb-9502-1b716e67c0d8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:54.300811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-32750628-2945-4dfb-9502-1b716e67c0d8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:54.307581 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-32750628-2945-4dfb-9502-1b716e67c0d8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1088 microversion: 2.1 time: 0.066722 Aug 29 23:21:54.308157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1851/3596] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:54 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:55.329069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:55.329607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:55.335691 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:55.336212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:55.336615 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:55.337477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:55.337742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:55.338148 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:55.399073 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:55.406661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-06c6845d-de6a-4a12-8903-c59d3dfdd9ef tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1138 microversion: 2.1 time: 0.082297 Aug 29 23:21:55.407221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1746/3597] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:55 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:56.427764 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:56.428451 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:56.435443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:56.435922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:56.436391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:56.437061 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:56.437572 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:56.437999 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:56.499338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:56.507016 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ca3cdf1f-db08-41c1-880a-a4171ef2299f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1186 microversion: 2.1 time: 0.083084 Aug 29 23:21:56.507562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1852/3598] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:56 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:57.528269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:57.528967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:57.536010 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:57.536525 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:57.536958 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:57.537646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:57.538097 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:57.538730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:57.614452 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:57.622149 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-c5edbc08-55ed-431f-902b-fd74dacb1e34 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1204 microversion: 2.1 time: 0.097706 Aug 29 23:21:57.623330 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1747/3599] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:57 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:21:58.644041 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:58.644784 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:58.651412 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:58.651920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:58.652381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:58.653077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:58.654046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:58.654475 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:58.737630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-377ca388-49d5-4a86-9511-72004ccdb5d6 req-c9448864-56fa-41a1-a1a4-67ecd5e92e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4e3ba1-45b5-4cab-a9c0-7f8818458b08", "tag": "763dbea8-741c-4d59-a5c4-0917f4feb1ef"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:21:58.748803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-377ca388-49d5-4a86-9511-72004ccdb5d6 req-c9448864-56fa-41a1-a1a4-67ecd5e92e03 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:58.749421 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-377ca388-49d5-4a86-9511-72004ccdb5d6 req-c9448864-56fa-41a1-a1a4-67ecd5e92e03 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:58.749953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-377ca388-49d5-4a86-9511-72004ccdb5d6 req-c9448864-56fa-41a1-a1a4-67ecd5e92e03 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:58.761479 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-377ca388-49d5-4a86-9511-72004ccdb5d6 req-c9448864-56fa-41a1-a1a4-67ecd5e92e03 service nova] Creating event network-changed:763dbea8-741c-4d59-a5c4-0917f4feb1ef for instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 on hv-cinder-85426 Aug 29 23:21:58.766657 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-377ca388-49d5-4a86-9511-72004ccdb5d6 req-c9448864-56fa-41a1-a1a4-67ecd5e92e03 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032942 Aug 29 23:21:58.767355 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1748/3600] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:21:58.806046 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:21:58.815445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-188041fe-0ef8-4150-a460-805760f93a62 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.175603 Aug 29 23:21:58.816013 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1853/3601] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:58 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:21:59.837262 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:21:59.837977 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:21:59.844727 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:59.845192 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:59.845619 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:21:59.846290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:21:59.846735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:21:59.850030 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:00.227261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:00.235476 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-24f3164e-cd84-4839-942f-d092a1c87a6b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.403011 Aug 29 23:22:00.236036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1749/3602] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:21:59 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:01.256691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:01.257302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:01.263990 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:01.264501 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:01.264939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:01.265648 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:01.266119 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:01.266519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:01.399891 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:01.407746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a82fec73-8ab3-4e70-8143-6cb649ce0948 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.154897 Aug 29 23:22:01.408571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1854/3603] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:01 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:02.429077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:02.429795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:02.432289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:02.436963 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:02.437450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:02.437886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:02.438582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:02.439626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:02.442806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:02.444166 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:02.599468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:02.607554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-e69b2a0b-df00-4492-b5c6-a37eed06e950 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.182286 Aug 29 23:22:02.608501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1750/3604] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:02 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:03.629386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:03.629986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:03.636305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:03.639273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:03.639273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:03.639273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:03.639273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:03.639558 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:03.643189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=67 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:03.775860 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:03.784301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-1726de66-9782-481e-a7b9-16480d07f0c6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.158668 Aug 29 23:22:03.784876 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1855/3605] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:03 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:04.805959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:04.806557 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:04.809084 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:04.809764 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=6 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:04.815413 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:04.815888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:04.816359 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:04.817034 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:04.817485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:04.818439 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:05.113474 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:05.121388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0c86b03c-f1f0-4c52-a1a0-87b8f014ff54 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.319779 Aug 29 23:22:05.121945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1751/3606] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:04 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:06.141310 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:06.141998 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:06.144799 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:06.145903 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:06.150873 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:06.151362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:06.151794 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:06.152538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:06.152991 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:06.153415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:06.311430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:06.320503 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5ca8cff7-a89d-42e5-ba8f-855e8682c25b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.182999 Aug 29 23:22:06.321388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1856/3607] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:06 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:07.347895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:07.347895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:07.350033 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:07.350182 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:07.351582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:07.352307 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:07.352755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:07.353173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:07.495081 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:07.504250 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3db663e1-f3ba-4fe6-b099-cf632f1fcfe1 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.165566 Aug 29 23:22:07.504710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1752/3608] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:07 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:08.524306 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:08.524968 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:08.531404 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:08.536550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:08.536550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:08.536550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:08.536550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:08.536869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:08.669415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:08.677839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b3705a03-355a-47d0-bb89-cd79fc8b9a2d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.157500 Aug 29 23:22:08.678458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1857/3609] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:08 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:08.696370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-db92d158-cf53-4064-a2bb-1e0ea991b121 req-3dac3964-90f5-4f99-ae95-bbad1242ac4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4e3ba1-45b5-4cab-a9c0-7f8818458b08", "name": "network-vif-plugged", "status": "completed", "tag": "763dbea8-741c-4d59-a5c4-0917f4feb1ef"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:08.706795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-db92d158-cf53-4064-a2bb-1e0ea991b121 req-3dac3964-90f5-4f99-ae95-bbad1242ac4b service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:08.707505 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-db92d158-cf53-4064-a2bb-1e0ea991b121 req-3dac3964-90f5-4f99-ae95-bbad1242ac4b service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:08.707940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-db92d158-cf53-4064-a2bb-1e0ea991b121 req-3dac3964-90f5-4f99-ae95-bbad1242ac4b service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:08.719094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-db92d158-cf53-4064-a2bb-1e0ea991b121 req-3dac3964-90f5-4f99-ae95-bbad1242ac4b service nova] Creating event network-vif-plugged:763dbea8-741c-4d59-a5c4-0917f4feb1ef for instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 on hv-cinder-85426 Aug 29 23:22:08.724846 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-db92d158-cf53-4064-a2bb-1e0ea991b121 req-3dac3964-90f5-4f99-ae95-bbad1242ac4b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032332 Aug 29 23:22:08.725454 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1753/3610] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:22:09.357201 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1812547185", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "networks": [{"uuid": "27a01ab4-5431-4490-a82f-c8394949120f"}]}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:09.410033 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] validate_networks() for [('27a01ab4-5431-4490-a82f-c8394949120f', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:22:09.700346 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:09.701083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:09.707965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:09.708484 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:09.708924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:09.709621 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:09.710075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:09.710502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:09.805954 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:22:09.806450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:22:09.806822 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:22:09.807338 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:22:09.807752 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:22:09.817735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:09.818210 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:09.818635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:09.819344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:09.819781 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:09.820228 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:09.837066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Getting quotas for project c4d8d7ba70a045aca8ef8982ca1302b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:22:09.841209 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Getting quotas for user 8df15176597f46149bc4ffae0463c12a and project c4d8d7ba70a045aca8ef8982ca1302b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:22:09.846241 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:09.853808 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:22:09.854261 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-998570ef-246a-4c04-aa69-bcab5bf4804d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1259 microversion: 2.1 time: 0.158233 Aug 29 23:22:09.854821 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1754/3611] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:09 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:22:09.856390 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:22:09.991571 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b8ff9033-cbc6-4a43-8170-1bf383449139 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638310 Aug 29 23:22:09.992408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1858/3612] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 23:22:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:22:10.003531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3bfe8ac6-b8c3-4ade-9ac6-b255be12a5ed tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:10.004184 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3bfe8ac6-b8c3-4ade-9ac6-b255be12a5ed tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:10.061244 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-3bfe8ac6-b8c3-4ade-9ac6-b255be12a5ed tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:10.073688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3bfe8ac6-b8c3-4ade-9ac6-b255be12a5ed tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1214 microversion: 2.1 time: 0.070250 Aug 29 23:22:10.073688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1755/3613] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:09 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:10.875746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:10.876389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:10.882823 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:10.886606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:10.886606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:10.886606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:10.886606 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:10.886946 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:11.017480 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:11.025882 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5eeaac65-7f21-41e0-877d-e7e003b29d7f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1444 microversion: 2.1 time: 0.154490 Aug 29 23:22:11.026641 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1859/3614] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:10 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:11.046814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:11.047567 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:11.054760 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:11.055186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:11.055623 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:11.056351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:11.056805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:11.057228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:11.093087 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-0b157f22-69d8-4855-b1e2-4a9f4d18968f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:11.093699 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-0b157f22-69d8-4855-b1e2-4a9f4d18968f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:11.147234 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-0b157f22-69d8-4855-b1e2-4a9f4d18968f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:11.154141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-0b157f22-69d8-4855-b1e2-4a9f4d18968f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1214 microversion: 2.1 time: 0.065029 Aug 29 23:22:11.154703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1860/3615] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:11 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:22:11.189616 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:11.197897 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b57070ee-fef8-47c6-97bd-eedfd09c2676 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1444 microversion: 2.1 time: 0.155043 Aug 29 23:22:11.198468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1756/3616] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:11 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:12.175180 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:12.175856 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:12.182818 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:12.183305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:12.183800 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:12.184521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:12.184972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:12.185391 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:12.245636 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:12.253273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ae3522ef-56db-4a2c-9d53-9649606741a9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1266 microversion: 2.1 time: 0.081976 Aug 29 23:22:12.254367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1861/3617] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:12 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:13.279043 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:13.279771 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:13.287300 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:13.287867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:13.288435 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:13.289199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:13.289661 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:13.290088 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:13.373876 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:13.382348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-4e017341-4bab-4927-ba5e-5f75eb5fa708 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1272 microversion: 2.1 time: 0.107240 Aug 29 23:22:13.383291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1757/3618] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:13 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:14.002067 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-deff70b2-e8b5-4616-85b9-e607240ce8d1 req-39f97a98-fbd0-42a2-96ce-2b9483421ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4e3ba1-45b5-4cab-a9c0-7f8818458b08", "tag": "763dbea8-741c-4d59-a5c4-0917f4feb1ef"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:14.012176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-deff70b2-e8b5-4616-85b9-e607240ce8d1 req-39f97a98-fbd0-42a2-96ce-2b9483421ce7 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:14.012866 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-deff70b2-e8b5-4616-85b9-e607240ce8d1 req-39f97a98-fbd0-42a2-96ce-2b9483421ce7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:14.013398 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-deff70b2-e8b5-4616-85b9-e607240ce8d1 req-39f97a98-fbd0-42a2-96ce-2b9483421ce7 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:14.025979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-deff70b2-e8b5-4616-85b9-e607240ce8d1 req-39f97a98-fbd0-42a2-96ce-2b9483421ce7 service nova] Creating event network-changed:763dbea8-741c-4d59-a5c4-0917f4feb1ef for instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 on hv-cinder-85426 Aug 29 23:22:14.031511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-deff70b2-e8b5-4616-85b9-e607240ce8d1 req-39f97a98-fbd0-42a2-96ce-2b9483421ce7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033534 Aug 29 23:22:14.032380 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1862/3619] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:22:14.405075 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:14.405685 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:14.420634 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:14.421350 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:14.421959 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:14.422820 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:14.423423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:14.424258 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:14.663080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:14.672101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ee57ba7d-ad5a-41df-8233-fc57cabfd70d tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1314 microversion: 2.1 time: 0.271023 Aug 29 23:22:14.673866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1758/3620] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:14 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:15.695642 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:15.696484 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:15.702728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:15.703207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:15.703666 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:15.704383 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:15.704839 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:15.705263 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:15.835302 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:15.842965 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-97a6cc95-87f5-423d-8ac5-8392f3ec5231 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1314 microversion: 2.1 time: 0.152757 Aug 29 23:22:15.843521 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1863/3621] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:15 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:16.047736 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-b7e05d4c-eff8-40ea-9221-f627c6fc8243 req-38da6e70-2d67-42e1-9242-b2ec986ae9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97a429c-cc14-4c00-a955-b5adb2ebb237", "tag": "fd6e7798-2a37-4820-a76f-47b2655da0ab"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:16.058200 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-b7e05d4c-eff8-40ea-9221-f627c6fc8243 req-38da6e70-2d67-42e1-9242-b2ec986ae9b5 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:16.058670 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-b7e05d4c-eff8-40ea-9221-f627c6fc8243 req-38da6e70-2d67-42e1-9242-b2ec986ae9b5 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:16.059095 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-b7e05d4c-eff8-40ea-9221-f627c6fc8243 req-38da6e70-2d67-42e1-9242-b2ec986ae9b5 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:16.070569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-b7e05d4c-eff8-40ea-9221-f627c6fc8243 req-38da6e70-2d67-42e1-9242-b2ec986ae9b5 service nova] Creating event network-changed:fd6e7798-2a37-4820-a76f-47b2655da0ab for instance f97a429c-cc14-4c00-a955-b5adb2ebb237 on hv-cinder-85426 Aug 29 23:22:16.075432 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-b7e05d4c-eff8-40ea-9221-f627c6fc8243 req-38da6e70-2d67-42e1-9242-b2ec986ae9b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031320 Aug 29 23:22:16.076003 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1759/3622] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:16.864243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:16.865349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:16.871673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:16.872157 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:16.872603 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:16.873278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:16.873724 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:16.874141 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:17.009775 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:17.017313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-129b0097-b174-41aa-bb14-c0216131be1c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1314 microversion: 2.1 time: 0.156923 Aug 29 23:22:17.017869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1864/3623] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:16 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:18.038896 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:18.039596 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:18.045734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:18.046219 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:18.046653 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:18.047338 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:18.047795 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:18.048259 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:18.175895 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:18.184213 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-78234059-b5b2-462d-8af1-8a31e37fb50c tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1314 microversion: 2.1 time: 0.150802 Aug 29 23:22:18.184788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1760/3624] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:18 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:19.205836 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:19.206430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:19.213197 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:19.213688 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:19.214140 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:19.215068 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:19.215524 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:19.215939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:19.358439 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:19.367040 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-80b0e2f3-2da6-4d42-9b8a-23fe44bd26bf tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1314 microversion: 2.1 time: 0.165112 Aug 29 23:22:19.367689 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1865/3625] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:19 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:20.389393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:20.389999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:20.392403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:20.397937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:20.398426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:20.398894 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:20.399569 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:20.400018 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:20.404903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:20.526458 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:20.534080 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-68ba732d-0817-4cb3-9c63-620bfd736a8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1314 microversion: 2.1 time: 0.148485 Aug 29 23:22:20.534681 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1761/3626] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:20 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:20.749612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-009d69b3-9548-4d1a-a08c-f898f4f6b042 req-cb3bce2e-6dc0-4472-86dd-f70bf9c4baba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97a429c-cc14-4c00-a955-b5adb2ebb237", "name": "network-vif-plugged", "status": "completed", "tag": "fd6e7798-2a37-4820-a76f-47b2655da0ab"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:20.754649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:20.760984 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-009d69b3-9548-4d1a-a08c-f898f4f6b042 req-cb3bce2e-6dc0-4472-86dd-f70bf9c4baba service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:20.761458 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-009d69b3-9548-4d1a-a08c-f898f4f6b042 req-cb3bce2e-6dc0-4472-86dd-f70bf9c4baba service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:20.761885 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-009d69b3-9548-4d1a-a08c-f898f4f6b042 req-cb3bce2e-6dc0-4472-86dd-f70bf9c4baba service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:20.772874 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-009d69b3-9548-4d1a-a08c-f898f4f6b042 req-cb3bce2e-6dc0-4472-86dd-f70bf9c4baba service nova] Creating event network-vif-plugged:fd6e7798-2a37-4820-a76f-47b2655da0ab for instance f97a429c-cc14-4c00-a955-b5adb2ebb237 on hv-cinder-85426 Aug 29 23:22:20.777889 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-009d69b3-9548-4d1a-a08c-f898f4f6b042 req-cb3bce2e-6dc0-4472-86dd-f70bf9c4baba service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Aug 29 23:22:20.779769 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1866/3627] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:21.554938 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:21.555544 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:21.561613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:21.562093 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:21.562533 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:21.563237 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:21.563687 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:21.564109 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:21.692177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:21.700174 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-600f11d0-a80b-4fb2-949b-edf4491f9c82 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1314 microversion: 2.1 time: 0.149308 Aug 29 23:22:21.700732 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1762/3628] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:21 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:22.717694 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=8 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:22.722548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:22.723249 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:22.729716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:22.730189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:22.730617 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:22.731290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:22.731736 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:22.732176 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:22.865710 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:22.873461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ed1f9a36-d4aa-4f90-aa69-2f6966b6ec54 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1314 microversion: 2.1 time: 0.156680 Aug 29 23:22:22.874037 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1867/3629] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:22 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:23.894004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:23.894613 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:23.901941 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:23.902426 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:23.902866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:23.903552 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:23.904004 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:23.904464 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:24.035328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:24.043999 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-947bc0a4-53dc-4fb0-bdd3-5b4ea0d5d247 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1498 microversion: 2.1 time: 0.153876 Aug 29 23:22:24.044597 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1763/3630] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:23 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:24.941275 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:24.941756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:24.949073 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:24.949552 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:24.949988 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:24.950672 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:24.951130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:24.951556 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:24.977634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:22:25.247278 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-2a65983f-9218-4dbf-bdcc-582f0a7015c9 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 204 len: 0 microversion: 2.1 time: 0.309561 Aug 29 23:22:25.247790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1868/3631] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:22:24 2022] DELETE /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:22:25.255966 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:25.256614 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:25.264199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:25.264798 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:25.265235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:25.265982 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:25.266510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:25.266991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:25.647924 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:25.651477 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-b8f4174d-ae52-4e8f-b5f4-7e05684948b4 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1504 microversion: 2.1 time: 0.399360 Aug 29 23:22:25.652042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1764/3632] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:25 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:25.796047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-751145886"}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:25.796680 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:25.802598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:25.803074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:25.803505 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:25.804196 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:25.804647 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:25.805126 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:25.929567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.network.security_group_api [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Removing security group ba9eff85-a177-4b26-bcf9-5d17e6691e42 from port 3a81e763-66f0-4256-8dff-721180b77137 Aug 29 23:22:26.302518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-fb09a180-2f3f-4c70-963f-2ecc2fd2d11b tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "POST /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/action" status: 202 len: 0 microversion: 2.1 time: 0.510698 Aug 29 23:22:26.304170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1869/3633] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 23:22:25 2022] POST /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:22:26.315015 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-40fb2a79-5bd3-453d-8856-4a506a4ba89a req-235e4722-d3a0-40ca-89f3-18b7d94c05ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02641e15-15cb-43b8-bcf0-26e27655413a", "tag": "3a81e763-66f0-4256-8dff-721180b77137"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:26.338491 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-40fb2a79-5bd3-453d-8856-4a506a4ba89a req-235e4722-d3a0-40ca-89f3-18b7d94c05ce service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:26.338950 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-40fb2a79-5bd3-453d-8856-4a506a4ba89a req-235e4722-d3a0-40ca-89f3-18b7d94c05ce service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:26.339545 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-40fb2a79-5bd3-453d-8856-4a506a4ba89a req-235e4722-d3a0-40ca-89f3-18b7d94c05ce service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:26.351483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-40fb2a79-5bd3-453d-8856-4a506a4ba89a req-235e4722-d3a0-40ca-89f3-18b7d94c05ce service nova] Creating event network-changed:3a81e763-66f0-4256-8dff-721180b77137 for instance 02641e15-15cb-43b8-bcf0-26e27655413a on hv-cinder-85426 Aug 29 23:22:26.357225 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-40fb2a79-5bd3-453d-8856-4a506a4ba89a req-235e4722-d3a0-40ca-89f3-18b7d94c05ce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045806 Aug 29 23:22:26.358077 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1765/3634] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:26.672985 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:26.673731 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:26.679732 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:26.680763 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:26.681195 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:26.681880 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:26.682329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:26.682745 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:27.017202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:27.030682 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-25cd88a4-ee92-401a-96d5-64e7038096e0 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1504 microversion: 2.1 time: 0.361407 Aug 29 23:22:27.031261 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1870/3635] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:26 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:27.516975 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-d3091558-09d9-4675-a1f2-a46685593976 req-9affa869-ef52-4e2b-9b50-965f5bdd70ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97a429c-cc14-4c00-a955-b5adb2ebb237", "name": "network-vif-deleted", "tag": "fd6e7798-2a37-4820-a76f-47b2655da0ab"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:27.527867 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-d3091558-09d9-4675-a1f2-a46685593976 req-9affa869-ef52-4e2b-9b50-965f5bdd70ac service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:27.528423 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-d3091558-09d9-4675-a1f2-a46685593976 req-9affa869-ef52-4e2b-9b50-965f5bdd70ac service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:27.528865 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-d3091558-09d9-4675-a1f2-a46685593976 req-9affa869-ef52-4e2b-9b50-965f5bdd70ac service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:27.541996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-d3091558-09d9-4675-a1f2-a46685593976 req-9affa869-ef52-4e2b-9b50-965f5bdd70ac service nova] Creating event network-vif-deleted:fd6e7798-2a37-4820-a76f-47b2655da0ab for instance f97a429c-cc14-4c00-a955-b5adb2ebb237 on hv-cinder-85426 Aug 29 23:22:27.547094 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-d3091558-09d9-4675-a1f2-a46685593976 req-9affa869-ef52-4e2b-9b50-965f5bdd70ac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037398 Aug 29 23:22:27.547886 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1766/3636] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:27.928101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:27.933076 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:27.936490 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:27.936979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:27.937409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:27.938105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:27.938600 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:27.939021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:28.024461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lazy-loading 'services' on Instance uuid 02641e15-15cb-43b8-bcf0-26e27655413a {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:22:28.052228 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:28.053130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:28.061201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:28.061693 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:28.062125 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:28.062910 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:28.063364 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:28.063785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:28.103492 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:28.104061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:28.104594 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:28.105110 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.objects.instance [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lazy-loading 'fault' on Instance uuid f97a429c-cc14-4c00-a955-b5adb2ebb237 {{(pid=128151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:22:28.150805 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:28.158488 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-da3504c8-a8cd-48f7-8318-0cb3cb4aac92 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 200 len: 1304 microversion: 2.1 time: 0.110401 Aug 29 23:22:28.159064 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1767/3637] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:28 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:28.249202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c6359ab8-ce74-4fb8-856a-fa45510d74eb tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "DELETE /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments/7071f8a7-1e6b-4c46-abfb-628b5deb2891" status: 202 len: 0 microversion: 2.1 time: 0.325226 Aug 29 23:22:28.249634 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1871/3638] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 23:22:27 2022] DELETE /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments/7071f8a7-1e6b-4c46-abfb-628b5deb2891 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:22:28.258321 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-cafdd063-afdb-48b3-9772-82eaaa96dfd0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:28.260808 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-cafdd063-afdb-48b3-9772-82eaaa96dfd0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:28.266788 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cafdd063-afdb-48b3-9772-82eaaa96dfd0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:28.267275 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cafdd063-afdb-48b3-9772-82eaaa96dfd0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:28.267711 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cafdd063-afdb-48b3-9772-82eaaa96dfd0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:28.268508 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cafdd063-afdb-48b3-9772-82eaaa96dfd0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:28.268964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cafdd063-afdb-48b3-9772-82eaaa96dfd0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:28.269393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-cafdd063-afdb-48b3-9772-82eaaa96dfd0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:28.300516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-cafdd063-afdb-48b3-9772-82eaaa96dfd0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046195 Aug 29 23:22:28.301083 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1768/3639] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 23:22:28 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:28.381615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-f5d02486-febe-42aa-bd80-27c066583307 req-f39388a4-f07b-4154-a22a-04c71d40ba8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02641e15-15cb-43b8-bcf0-26e27655413a", "tag": "3a81e763-66f0-4256-8dff-721180b77137"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:28.392381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-f5d02486-febe-42aa-bd80-27c066583307 req-f39388a4-f07b-4154-a22a-04c71d40ba8b service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:28.394114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-f5d02486-febe-42aa-bd80-27c066583307 req-f39388a4-f07b-4154-a22a-04c71d40ba8b service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:28.394114 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-f5d02486-febe-42aa-bd80-27c066583307 req-f39388a4-f07b-4154-a22a-04c71d40ba8b service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:28.405467 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-f5d02486-febe-42aa-bd80-27c066583307 req-f39388a4-f07b-4154-a22a-04c71d40ba8b service nova] Creating event network-changed:3a81e763-66f0-4256-8dff-721180b77137 for instance 02641e15-15cb-43b8-bcf0-26e27655413a on hv-cinder-85426 Aug 29 23:22:28.410568 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-f5d02486-febe-42aa-bd80-27c066583307 req-f39388a4-f07b-4154-a22a-04c71d40ba8b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033049 Aug 29 23:22:28.411456 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1872/3640] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:29.181646 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:29.182571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: f97a429c-cc14-4c00-a955-b5adb2ebb237] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:29.188833 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:29.189314 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:29.189751 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:29.190444 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:29.190898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:29.191325 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:29.207333 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] HTTP exception thrown: Instance f97a429c-cc14-4c00-a955-b5adb2ebb237 could not be found. Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Request method failure captured: Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 HTTP/1.1 Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUoftXaxiB8b_iKv2OboI62CTer-O9a1-UJZWiHInkt5oGt44cdQSEs2vkn0pZ98KiQS6YJgvWZbFmZEYolxFr7Ohddt6kOSrMWQzFh-exRD9UhfHe_ieyzbM2P-aaUu9o2Xusa1RRxh3ZQ5yyBI6yxYRaf5dCq6gAu-IEtItlKsnMw Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: c4d8d7ba70a045aca8ef8982ca1302b0 Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesActionsTest-348278797 Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:22:29.209058 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c4d8d7ba70a045aca8ef8982ca1302b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c4d8d7ba70a045aca8ef8982ca1302b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c4d8d7ba70a045aca8ef8982ca1302b0", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c4d8d7ba70a045aca8ef8982ca1302b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesActionsTest-348278797 Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: c4d8d7ba70a045aca8ef8982ca1302b0 Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesActionsTest-348278797 Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesActionsTest-348278797-project Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 8df15176597f46149bc4ffae0463c12a Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesActionsTest-348278797-project Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance f97a429c-cc14-4c00-a955-b5adb2ebb237 could not be found. Aug 29 23:22:29.210556 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': 'f97a429c-cc14-4c00-a955-b5adb2ebb237'} Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97a429c-cc14-4c00-a955-b5adb2ebb237 could not be found. Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:22:29.211438 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97a429c-cc14-4c00-a955-b5adb2ebb237 could not be found. Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97a429c-cc14-4c00-a955-b5adb2ebb237 could not be found. Aug 29 23:22:29.213028 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:29.214354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Returning 404 to user: Instance f97a429c-cc14-4c00-a955-b5adb2ebb237 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:22:29.214354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0c0ccd48-0080-4dc7-9bc8-c98b40845561 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237" status: 404 len: 111 microversion: 2.1 time: 0.034446 Aug 29 23:22:29.214354 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1769/3641] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:29 2022] GET /compute/v2.1/servers/f97a429c-cc14-4c00-a955-b5adb2ebb237 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:22:29.262426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-831980381", "imageRef": "b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb", "flavorRef": "452", "networks": [{"uuid": "27a01ab4-5431-4490-a82f-c8394949120f"}]}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:29.313037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d0705821-f9fc-4717-ada9-44dfefa2f32f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:29.315286 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d0705821-f9fc-4717-ada9-44dfefa2f32f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:29.322743 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d0705821-f9fc-4717-ada9-44dfefa2f32f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:29.323242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d0705821-f9fc-4717-ada9-44dfefa2f32f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:29.323710 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d0705821-f9fc-4717-ada9-44dfefa2f32f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:29.324460 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d0705821-f9fc-4717-ada9-44dfefa2f32f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:29.324951 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d0705821-f9fc-4717-ada9-44dfefa2f32f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:29.325376 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d0705821-f9fc-4717-ada9-44dfefa2f32f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:29.325535 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.network.neutron [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] validate_networks() for [('27a01ab4-5431-4490-a82f-c8394949120f', None, None, None, None, None)] {{(pid=128150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:22:29.353485 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=100 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:29.358450 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d0705821-f9fc-4717-ada9-44dfefa2f32f tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049357 Aug 29 23:22:29.359024 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1770/3642] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 23:22:29 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:22:29.678295 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Flavor limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:22:29.678721 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Image limits 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:22:29.679224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Flavor pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:22:29.679635 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Image pref 0:0:0 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:22:29.680655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.virt.hardware [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:22:29.689573 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:29.690047 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:29.690472 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:29.691182 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:29.691628 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:29.692043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:29.708893 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Getting quotas for project c4d8d7ba70a045aca8ef8982ca1302b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:22:29.712922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.quota [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Getting quotas for user 8df15176597f46149bc4ffae0463c12a and project c4d8d7ba70a045aca8ef8982ca1302b0. Resources: {'instances', 'cores', 'ram'} {{(pid=128150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:22:29.723592 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Going to run 1 instances... {{(pid=128150) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:22:29.725955 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3a29ae8-fd6f-4c1f-91a3-d2b1f7c3cedb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:22:29.861052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-54fd14e4-b27a-4b66-a318-fc1683d1671f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604428 Aug 29 23:22:29.861651 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1873/3643] 10.222.0.59 () {60 vars in 1147 bytes} [Mon Aug 29 23:22:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:22:29.873199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-894e9a5c-7212-4e28-9162-9ef0308011e8 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:29.873860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-894e9a5c-7212-4e28-9162-9ef0308011e8 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:29.930917 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-894e9a5c-7212-4e28-9162-9ef0308011e8 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:29.937945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-894e9a5c-7212-4e28-9162-9ef0308011e8 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1213 microversion: 2.1 time: 0.068954 Aug 29 23:22:29.938721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1771/3644] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:29 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:30.372077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-76090339-913d-4bc6-9566-54c6bf88a3f0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:30.374376 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-76090339-913d-4bc6-9566-54c6bf88a3f0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:30.381356 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76090339-913d-4bc6-9566-54c6bf88a3f0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:30.381838 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76090339-913d-4bc6-9566-54c6bf88a3f0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:30.382268 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76090339-913d-4bc6-9566-54c6bf88a3f0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:30.382952 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76090339-913d-4bc6-9566-54c6bf88a3f0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:30.383986 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76090339-913d-4bc6-9566-54c6bf88a3f0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:30.384429 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-76090339-913d-4bc6-9566-54c6bf88a3f0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:30.386854 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:30.412783 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-76090339-913d-4bc6-9566-54c6bf88a3f0 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045530 Aug 29 23:22:30.413253 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1874/3645] 10.222.0.59 () {58 vars in 1302 bytes} [Mon Aug 29 23:22:30 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:22:30.423671 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:30.424234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:30.431481 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:30.431920 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:30.432370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:30.433046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:30.433489 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:30.433902 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:30.508312 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] HTTP exception thrown: Instance 02641e15-15cb-43b8-bcf0-26e27655413a is not attached to volume 7071f8a7-1e6b-4c46-abfb-628b5deb2891 Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Request method failure captured: Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: DELETE /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments/7071f8a7-1e6b-4c46-abfb-628b5deb2891 HTTP/1.1 Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUmkmETPvDh5l8z0uJm5VlMQadOh2LiHViZrx9Ve48dOdYeZnFI66Bs0MnXz6oANNlr4N7RBCIo2nLT1jwaMwwdFeFm42_IvMUR7O2innJP_GkdglpBjvXa0tB5jcDzhfbjBc6UvnejnvfVmMotRryo-GW0eIM5dVyXbylBCiMxv3ms Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: 8b61dd30bd20426990ed70288f69e40b Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-TestMinimumBasicScenario-314095160 Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:22:30.511264 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8b61dd30bd20426990ed70288f69e40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8b61dd30bd20426990ed70288f69e40b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8b61dd30bd20426990ed70288f69e40b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8b61dd30bd20426990ed70288f69e40b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-TestMinimumBasicScenario-314095160 Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: 8b61dd30bd20426990ed70288f69e40b Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-TestMinimumBasicScenario-314095160 Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-TestMinimumBasicScenario-314095160-project Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 79a2748b61b4451f9215a4f8eea5dea2 Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-TestMinimumBasicScenario-314095160-project Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:22:30.512660 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 02641e15-15cb-43b8-bcf0-26e27655413a is not attached to volume 7071f8a7-1e6b-4c46-abfb-628b5deb2891 Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'server_id': '02641e15-15cb-43b8-bcf0-26e27655413a', 'id': '7071f8a7-1e6b-4c46-abfb-628b5deb2891'} Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7071f8a7-1e6b-4c46-abfb-628b5deb2891. Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:22:30.513388 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02641e15-15cb-43b8-bcf0-26e27655413a is not attached to volume 7071f8a7-1e6b-4c46-abfb-628b5deb2891 Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02641e15-15cb-43b8-bcf0-26e27655413a is not attached to volume 7071f8a7-1e6b-4c46-abfb-628b5deb2891 Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:30.514745 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Returning 404 to user: Instance 02641e15-15cb-43b8-bcf0-26e27655413a is not attached to volume 7071f8a7-1e6b-4c46-abfb-628b5deb2891 {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:22:30.515708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-d8461677-a4a1-4848-ac98-e1c05ca2e4b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "DELETE /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments/7071f8a7-1e6b-4c46-abfb-628b5deb2891" status: 404 len: 154 microversion: 2.1 time: 0.093084 Aug 29 23:22:30.515708 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1772/3646] 10.222.0.59 () {58 vars in 1416 bytes} [Mon Aug 29 23:22:30 2022] DELETE /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a/os-volume_attachments/7071f8a7-1e6b-4c46-abfb-628b5deb2891 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:22:30.958922 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:30.959534 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:30.966714 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:30.967894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:30.967894 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:30.968339 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:30.968791 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:30.969208 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:31.030500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:31.039034 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b26c8e11-9160-48eb-9968-427ef0f2ca90 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1209 microversion: 2.1 time: 0.084311 Aug 29 23:22:31.040207 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1875/3647] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:30 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:31.809296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:31.809787 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:31.816079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:31.816603 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:31.817036 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:31.817733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:31.818663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:31.819130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:31.846319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:22:32.062497 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:32.063069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:32.070297 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:32.070905 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:32.071670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:32.072447 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:32.072907 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:32.073335 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:32.155949 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-df24a9b1-33a8-4fe8-8750-f517863fa2b6 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "DELETE /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 204 len: 0 microversion: 2.1 time: 0.350507 Aug 29 23:22:32.156554 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1773/3648] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:22:31 2022] DELETE /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:22:32.165786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:32.166480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:32.172757 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:32.173328 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:32.173844 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:32.175101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:32.175568 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:32.176042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:32.219381 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:32.227379 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b9dcad52-4223-4618-bd44-31b171cb90d6 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1283 microversion: 2.1 time: 0.169426 Aug 29 23:22:32.228069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1876/3649] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:32 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:22:32.322234 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:32.333537 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-6e1383ff-d649-4486-8e07-7aef75091c04 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1555 microversion: 2.1 time: 0.172399 Aug 29 23:22:32.334103 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1774/3650] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:32 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:33.248170 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:33.248715 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:33.255099 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:33.255584 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:33.256023 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:33.256746 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:33.257203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:33.257631 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:33.356721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:33.357332 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:33.363666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:33.364162 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:33.364622 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:33.365311 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:33.365763 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:33.366186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:33.389403 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:33.397301 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-b077817f-74e1-4b42-98b2-c4ac346e4269 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1313 microversion: 2.1 time: 0.153116 Aug 29 23:22:33.397864 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1877/3651] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:33 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:33.492832 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:33.500558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-afe281a0-66c6-4875-b396-f45ef4846273 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1555 microversion: 2.1 time: 0.148316 Aug 29 23:22:33.501066 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1775/3652] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:33 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:22:34.421367 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:34.422751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:34.432901 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:34.433966 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:34.434625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:34.435509 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:34.436127 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:34.436910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:34.521308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:34.522513 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:34.530288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:34.530988 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:34.531991 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:34.532558 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:34.533153 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:34.533747 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:34.751320 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:34.760026 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ef6570e7-df1f-4c8d-8c33-3214dcec568c tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1555 microversion: 2.1 time: 0.242610 Aug 29 23:22:34.760666 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1776/3653] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:34 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:34.765145 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-acf69db3-7e11-4753-9d06-4be9250ad9d9 req-fed45338-4024-40d1-8ed3-b69a82eb2c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02641e15-15cb-43b8-bcf0-26e27655413a", "name": "network-vif-deleted", "tag": "3a81e763-66f0-4256-8dff-721180b77137"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:34.775289 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-acf69db3-7e11-4753-9d06-4be9250ad9d9 req-fed45338-4024-40d1-8ed3-b69a82eb2c2d service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:34.775767 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-acf69db3-7e11-4753-9d06-4be9250ad9d9 req-fed45338-4024-40d1-8ed3-b69a82eb2c2d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:34.776245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-acf69db3-7e11-4753-9d06-4be9250ad9d9 req-fed45338-4024-40d1-8ed3-b69a82eb2c2d service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:34.788078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-acf69db3-7e11-4753-9d06-4be9250ad9d9 req-fed45338-4024-40d1-8ed3-b69a82eb2c2d service nova] Creating event network-vif-deleted:3a81e763-66f0-4256-8dff-721180b77137 for instance 02641e15-15cb-43b8-bcf0-26e27655413a on hv-cinder-85426 Aug 29 23:22:34.794011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-acf69db3-7e11-4753-9d06-4be9250ad9d9 req-fed45338-4024-40d1-8ed3-b69a82eb2c2d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032141 Aug 29 23:22:34.794611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1777/3654] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:34.797679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:34.805646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6dde470e-5db3-4703-83cf-1a4dcb235b37 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1313 microversion: 2.1 time: 0.389858 Aug 29 23:22:34.818819 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1878/3655] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:34 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:34.916696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-967e4fd1-c815-444c-9b00-dd68d8ee1615 req-8d23d569-802a-437f-bffa-95ce451996f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0248f331-786a-4401-beb4-39e1212a65dc", "tag": "c2959377-01a9-4a83-a474-021d48056634"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:34.927503 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:34.937102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-967e4fd1-c815-444c-9b00-dd68d8ee1615 req-8d23d569-802a-437f-bffa-95ce451996f1 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:34.938235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-967e4fd1-c815-444c-9b00-dd68d8ee1615 req-8d23d569-802a-437f-bffa-95ce451996f1 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:34.938974 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-967e4fd1-c815-444c-9b00-dd68d8ee1615 req-8d23d569-802a-437f-bffa-95ce451996f1 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:34.950571 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-967e4fd1-c815-444c-9b00-dd68d8ee1615 req-8d23d569-802a-437f-bffa-95ce451996f1 service nova] Creating event network-changed:c2959377-01a9-4a83-a474-021d48056634 for instance 0248f331-786a-4401-beb4-39e1212a65dc on hv-cinder-85426 Aug 29 23:22:34.955572 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-967e4fd1-c815-444c-9b00-dd68d8ee1615 req-8d23d569-802a-437f-bffa-95ce451996f1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045103 Aug 29 23:22:34.956342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1778/3656] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:35.781227 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:35.781869 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:35.789344 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:35.790230 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:35.790681 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:35.791388 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:35.791851 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:35.792316 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:35.824244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:35.824754 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:35.825428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:35.825735 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lazy-loading 'fault' on Instance uuid 02641e15-15cb-43b8-bcf0-26e27655413a {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:22:35.830290 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:35.831011 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:35.839607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:35.840091 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:35.840559 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:35.841936 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:35.842775 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:35.843372 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:35.899426 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a2748b61b4451f9215a4f8eea5dea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b61dd30bd20426990ed70288f69e40b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:35.907153 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a8ba1ca6-c0c4-43f5-a7d1-a71b0127e249 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 200 len: 1349 microversion: 2.1 time: 0.129590 Aug 29 23:22:35.908121 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1879/3657] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:35 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 1349 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:35.981940 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:35.989644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ab0a7c42-e94f-42ed-9a36-2b5bef590cff tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1313 microversion: 2.1 time: 0.166324 Aug 29 23:22:35.990215 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1779/3658] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:35 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:22:36.929510 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:36.930177 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] [instance: 02641e15-15cb-43b8-bcf0-26e27655413a] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:36.932511 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:36.937202 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:36.937679 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:36.938107 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:36.938790 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:36.939243 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:36.939663 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:36.955255 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.wsgi [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] HTTP exception thrown: Instance 02641e15-15cb-43b8-bcf0-26e27655413a could not be found. Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Request method failure captured: Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: request: GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a HTTP/1.1 Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept: application/json Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Accept-Encoding: identity Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Connection: close Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Length: 0 Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Content-Type: application/json Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Host: 10.222.0.59 Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Openstack-System-Scope: None Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: User-Agent: python-urllib3/1.26.12 Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Auth-Token: gAAAAABjDUmkmETPvDh5l8z0uJm5VlMQadOh2LiHViZrx9Ve48dOdYeZnFI66Bs0MnXz6oANNlr4N7RBCIo2nLT1jwaMwwdFeFm42_IvMUR7O2innJP_GkdglpBjvXa0tB5jcDzhfbjBc6UvnejnvfVmMotRryo-GW0eIM5dVyXbylBCiMxv3ms Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Id: None Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Domain-Name: None Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Identity-Status: Confirmed Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Is-Admin-Project: True Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Id: default Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Domain-Name: Default Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Id: 8b61dd30bd20426990ed70288f69e40b Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Project-Name: tempest-TestMinimumBasicScenario-314095160 Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Role: reader,member Aug 29 23:22:36.957027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Roles: reader,member Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8b61dd30bd20426990ed70288f69e40b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8b61dd30bd20426990ed70288f69e40b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8b61dd30bd20426990ed70288f69e40b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8b61dd30bd20426990ed70288f69e40b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant: tempest-TestMinimumBasicScenario-314095160 Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Id: 8b61dd30bd20426990ed70288f69e40b Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-Tenant-Name: tempest-TestMinimumBasicScenario-314095160 Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User: tempest-TestMinimumBasicScenario-314095160-project Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Id: default Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Domain-Name: Default Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Id: 79a2748b61b4451f9215a4f8eea5dea2 Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: X-User-Name: tempest-TestMinimumBasicScenario-314095160-project Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: method: > Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: exception: Instance 02641e15-15cb-43b8-bcf0-26e27655413a could not be found. Aug 29 23:22:36.958358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: action_args: {'id': '02641e15-15cb-43b8-bcf0-26e27655413a'} Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02641e15-15cb-43b8-bcf0-26e27655413a could not be found. Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:22:36.959269 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02641e15-15cb-43b8-bcf0-26e27655413a could not be found. Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02641e15-15cb-43b8-bcf0-26e27655413a could not be found. Aug 29 23:22:36.960702 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR nova.api.openstack.wsgi Aug 29 23:22:36.962549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Returning 404 to user: Instance 02641e15-15cb-43b8-bcf0-26e27655413a could not be found. {{(pid=128150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:22:36.962549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-89a5c032-50e9-4d65-8259-08b819e2802a tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a" status: 404 len: 111 microversion: 2.1 time: 0.032763 Aug 29 23:22:36.962549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1880/3659] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:36 2022] GET /compute/v2.1/servers/02641e15-15cb-43b8-bcf0-26e27655413a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:22:36.967903 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f91d93f9-5d90-49fc-9b6e-1405d9dcafe4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] Calling method '.version_select at 0x7febd4fc2a60>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:37.011756 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:37.012389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:37.018840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:37.019321 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:37.019777 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:37.020466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:37.020920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:37.021342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:37.051944 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f91d93f9-5d90-49fc-9b6e-1405d9dcafe4 tempest-TestMinimumBasicScenario-314095160 tempest-TestMinimumBasicScenario-314095160-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1215415109" status: 202 len: 0 microversion: 2.1 time: 0.087582 Aug 29 23:22:37.052486 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1780/3660] 10.222.0.59 () {58 vars in 1272 bytes} [Mon Aug 29 23:22:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1215415109 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:22:37.158805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:37.167203 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bdd8e6da-3353-4ed0-8987-eb4356db91b2 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1313 microversion: 2.1 time: 0.160333 Aug 29 23:22:37.167770 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1881/3661] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:37 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:22:38.188271 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:38.188884 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:38.195624 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:38.196118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:38.196585 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:38.197276 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:38.197729 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:38.198155 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:38.519893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:38.519893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0d47c46b-5076-4bb4-85f6-8f39cceed431 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1313 microversion: 2.1 time: 0.153267 Aug 29 23:22:38.519893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1781/3662] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:38 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:39.358567 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:39.359117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:39.365937 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:39.366437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:39.366870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:39.367550 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:39.368054 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:39.368508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:39.540130 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:39.547846 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6d9756ac-aa79-43f8-84d0-b7536bf41351 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1313 microversion: 2.1 time: 0.193950 Aug 29 23:22:39.552251 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1882/3663] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:39 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:40.567121 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell0:SELECT=2 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:40.571730 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:40.573046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:40.579740 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:40.580521 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:40.581170 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:40.581870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:40.582319 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:40.582874 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:40.736664 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:40.748053 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-16c0a5d4-8a8d-460d-93fa-463d5e998625 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1313 microversion: 2.1 time: 0.182190 Aug 29 23:22:40.749562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1782/3664] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:40 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:41.030529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-ad309bab-08ef-45e1-b5ee-356f2b326c5d req-90073c05-9622-43fc-bd11-f65f9bdce75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0248f331-786a-4401-beb4-39e1212a65dc", "name": "network-vif-plugged", "status": "completed", "tag": "c2959377-01a9-4a83-a474-021d48056634"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:41.035599 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:41.036557 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell0:SELECT=6 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:41.043461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-ad309bab-08ef-45e1-b5ee-356f2b326c5d req-90073c05-9622-43fc-bd11-f65f9bdce75f service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:41.044050 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-ad309bab-08ef-45e1-b5ee-356f2b326c5d req-90073c05-9622-43fc-bd11-f65f9bdce75f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:41.044478 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-ad309bab-08ef-45e1-b5ee-356f2b326c5d req-90073c05-9622-43fc-bd11-f65f9bdce75f service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:41.055410 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-ad309bab-08ef-45e1-b5ee-356f2b326c5d req-90073c05-9622-43fc-bd11-f65f9bdce75f service nova] Creating event network-vif-plugged:c2959377-01a9-4a83-a474-021d48056634 for instance 0248f331-786a-4401-beb4-39e1212a65dc on hv-cinder-85426 Aug 29 23:22:41.061655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-ad309bab-08ef-45e1-b5ee-356f2b326c5d req-90073c05-9622-43fc-bd11-f65f9bdce75f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034869 Aug 29 23:22:41.062319 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1883/3665] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:41.770547 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:41.771267 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:41.778220 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:41.778733 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:41.779177 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:41.780046 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:41.780695 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:41.781104 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:41.927089 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:41.936455 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-aabfd2a1-8799-4320-8976-f87a8b4f0c33 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1313 microversion: 2.1 time: 0.170428 Aug 29 23:22:41.937042 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1783/3666] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:41 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:42.959974 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:42.961409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:42.967930 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:42.968450 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:42.968884 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:42.969574 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:42.970025 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:42.970444 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:43.121241 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:43.130762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-520f0e5c-3c41-401c-b81e-f3dc9b9ab8df tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1313 microversion: 2.1 time: 0.176297 Aug 29 23:22:43.149430 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1884/3667] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:42 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:44.156696 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:44.157310 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:44.164448 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:44.164993 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:44.165793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:44.167101 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:44.168069 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:44.168620 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:44.355266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:44.363735 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a9457858-398f-421f-81f9-ac4a7d7a0277 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1497 microversion: 2.1 time: 0.210825 Aug 29 23:22:44.364609 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1784/3668] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:44 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:45.141445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:45.141445 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:45.151123 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:45.152508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:45.152947 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:45.153652 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:45.154104 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:45.154519 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:45.184006 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Going to try to terminate instance {{(pid=128150) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:22:45.522485 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-bb8210a4-adcd-456c-99fd-5046ff47d0f7 tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 204 len: 0 microversion: 2.1 time: 0.390622 Aug 29 23:22:45.523389 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1885/3669] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:22:45 2022] DELETE /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:22:45.532456 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:45.533316 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:45.540422 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:45.540989 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:45.542070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:45.543180 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:45.543704 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:45.544246 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:45.784223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:45.793079 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7619092f-d9dc-47fa-98fc-f73a2428cd8f tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1503 microversion: 2.1 time: 0.264572 Aug 29 23:22:45.794078 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1785/3670] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:45 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:22:46.814466 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:46.815179 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:46.821668 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:46.822154 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:46.822591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:46.823284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:46.823744 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:46.824187 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:46.956767 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:46.965667 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a41eb194-4aa6-4582-86c6-65199d152a8b tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1503 microversion: 2.1 time: 0.155497 Aug 29 23:22:46.966256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1886/3671] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:46 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:47.580098 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-73bcd08a-ff6c-4ab3-8d6d-80fa4a6a3e30 req-cd098f4b-3d0c-43a3-ac96-ced257b38ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0248f331-786a-4401-beb4-39e1212a65dc", "name": "network-vif-deleted", "tag": "c2959377-01a9-4a83-a474-021d48056634"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:22:47.590141 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-73bcd08a-ff6c-4ab3-8d6d-80fa4a6a3e30 req-cd098f4b-3d0c-43a3-ac96-ced257b38ffb service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:47.590606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-73bcd08a-ff6c-4ab3-8d6d-80fa4a6a3e30 req-cd098f4b-3d0c-43a3-ac96-ced257b38ffb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:47.591169 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-73bcd08a-ff6c-4ab3-8d6d-80fa4a6a3e30 req-cd098f4b-3d0c-43a3-ac96-ced257b38ffb service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:47.602371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-73bcd08a-ff6c-4ab3-8d6d-80fa4a6a3e30 req-cd098f4b-3d0c-43a3-ac96-ced257b38ffb service nova] Creating event network-vif-deleted:c2959377-01a9-4a83-a474-021d48056634 for instance 0248f331-786a-4401-beb4-39e1212a65dc on hv-cinder-85426 Aug 29 23:22:47.607734 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-73bcd08a-ff6c-4ab3-8d6d-80fa4a6a3e30 req-cd098f4b-3d0c-43a3-ac96-ced257b38ffb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031310 Aug 29 23:22:47.608361 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1786/3672] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:22:47.986844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:47.987461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:47.999562 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:48.000358 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:48.001252 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:48.001828 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:48.002300 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:48.006063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:48.042587 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:48.043021 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:48.043461 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:48.043963 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lazy-loading 'fault' on Instance uuid 0248f331-786a-4401-beb4-39e1212a65dc {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:22:48.091477 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df15176597f46149bc4ffae0463c12a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d8d7ba70a045aca8ef8982ca1302b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:22:48.100976 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5cc13594-a768-46ad-bee7-e163b482928a tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 200 len: 1303 microversion: 2.1 time: 0.117474 Aug 29 23:22:48.101835 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1887/3673] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:47 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:22:49.126686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:22:49.127393 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] [instance: 0248f331-786a-4401-beb4-39e1212a65dc] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:22:49.133587 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:49.134072 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:49.138164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:49.138164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:22:49.138164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:22:49.138164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:22:49.149672 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] HTTP exception thrown: Instance 0248f331-786a-4401-beb4-39e1212a65dc could not be found. Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Request method failure captured: Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc HTTP/1.1 Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUoftXaxiB8b_iKv2OboI62CTer-O9a1-UJZWiHInkt5oGt44cdQSEs2vkn0pZ98KiQS6YJgvWZbFmZEYolxFr7Ohddt6kOSrMWQzFh-exRD9UhfHe_ieyzbM2P-aaUu9o2Xusa1RRxh3ZQ5yyBI6yxYRaf5dCq6gAu-IEtItlKsnMw Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: c4d8d7ba70a045aca8ef8982ca1302b0 Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-VolumesActionsTest-348278797 Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:22:49.151288 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c4d8d7ba70a045aca8ef8982ca1302b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c4d8d7ba70a045aca8ef8982ca1302b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c4d8d7ba70a045aca8ef8982ca1302b0", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c4d8d7ba70a045aca8ef8982ca1302b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-VolumesActionsTest-348278797 Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: c4d8d7ba70a045aca8ef8982ca1302b0 Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-VolumesActionsTest-348278797 Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-VolumesActionsTest-348278797-project Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: 8df15176597f46149bc4ffae0463c12a Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-VolumesActionsTest-348278797-project Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 0248f331-786a-4401-beb4-39e1212a65dc could not be found. Aug 29 23:22:49.152870 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '0248f331-786a-4401-beb4-39e1212a65dc'} Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0248f331-786a-4401-beb4-39e1212a65dc could not be found. Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:22:49.153678 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0248f331-786a-4401-beb4-39e1212a65dc could not be found. Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0248f331-786a-4401-beb4-39e1212a65dc could not be found. Aug 29 23:22:49.155032 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:22:49.156294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] Returning 404 to user: Instance 0248f331-786a-4401-beb4-39e1212a65dc could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:22:49.156294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-0e28de1e-d8e2-4c84-942c-9edaf3bd0b1e tempest-VolumesActionsTest-348278797 tempest-VolumesActionsTest-348278797-project] 10.222.0.59 "GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc" status: 404 len: 111 microversion: 2.1 time: 0.030880 Aug 29 23:22:49.156294 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1787/3674] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:22:49 2022] GET /compute/v2.1/servers/0248f331-786a-4401-beb4-39e1212a65dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:24:14.037029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1f080f3b-0fd2-4de8-bc6f-0359e6c58244] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 23:24:14.037594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:14.038596 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:14.042545 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:24:14.043074 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:14.049218 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:14.057761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:14.057761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:14.057761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:14.057761 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:14.058224 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:14.074145 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lazy-loading 'flavor' on Instance uuid 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:24:14.379542 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a01103b3-99c1-4297-ba85-66a3dd3be62f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "POST /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08/action" status: 202 len: 0 microversion: 2.1 time: 0.344416 Aug 29 23:24:14.380128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1888/3675] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 23:24:14 2022] POST /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:24:14.386467 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:14.387212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:14.391134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:14.391742 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:14.398129 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:14.398607 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:14.399037 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:14.399723 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:14.400201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:14.400625 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:14.686308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:14.694409 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-73b019c6-9b3b-4692-97dc-6d9bd84de3ca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.309896 Aug 29 23:24:14.694964 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1788/3676] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:14 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:15.717029 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:15.717716 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:15.724691 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:15.725166 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:15.725591 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:15.726258 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:15.726703 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:15.727117 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:15.732314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] [1f080f3b-0fd2-4de8-bc6f-0359e6c58244] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 33022. Aug 29 23:24:15.787079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:24:15.787232 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: Mon Aug 29 23:24:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 (ip 10.222.0.59) !!! Aug 29 23:24:15.919314 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:15.928912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-6f3e5995-1fa4-476c-9e16-0e196ea2eee0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.217315 Aug 29 23:24:15.929487 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1889/3677] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:15 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:16.950205 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:16.950818 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:16.955201 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:24:16.955351 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:24:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 (ip 10.222.0.59) !!! Aug 29 23:24:16.962826 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:16.963308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:16.963744 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:16.964480 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:16.964928 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:16.965347 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:17.094562 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:17.102976 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-deaefb04-b8c8-44fa-90e0-9cbfe3012250 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.156888 Aug 29 23:24:17.103534 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1789/3678] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:16 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:18.125303 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:18.125892 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:18.132833 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:18.133311 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:18.133743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:18.134423 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:18.134878 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:18.135305 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:18.263349 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:18.271717 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-d3874917-60b7-433e-91a2-8450f9ec90d2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.150313 Aug 29 23:24:18.272323 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1890/3679] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:18 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:19.292965 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:19.293579 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:19.299996 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:19.300506 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:19.300946 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:19.301630 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:19.302085 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:19.302510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:19.433864 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:19.441953 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-a3d94b2a-61de-43b7-90de-bea3133972c8 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.152811 Aug 29 23:24:19.442504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1790/3680] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:19 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:20.462897 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:20.463508 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:20.469941 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:20.470956 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:20.471384 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:20.472053 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:20.472525 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:20.472939 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:20.604060 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:20.611844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a86642cd-4115-4500-990f-bac5f92e4eca tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.152807 Aug 29 23:24:20.612457 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1891/3681] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:20 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:21.632877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:21.633494 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:21.639387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:21.639872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:21.640357 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:21.641051 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:21.641510 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:21.641935 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:21.769021 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:21.779147 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-419e49cf-554a-4338-8173-e70becb32389 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.150230 Aug 29 23:24:21.779720 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1791/3682] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:21 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:22.802428 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:22.802949 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:22.808912 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:22.812533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:22.812533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:22.812533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:22.812533 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:22.813012 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:22.941877 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:22.949566 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-ef177731-b80b-433b-8662-c30bfc65e825 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.152196 Aug 29 23:24:22.950136 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1892/3683] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:22 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:23.971134 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:23.971741 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:23.978157 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:23.978679 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:23.979118 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:23.979806 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:23.980291 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:23.980726 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:24.118531 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:24.126245 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-47ca56c9-184d-4dcf-b973-81fa0d44865b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.159227 Aug 29 23:24:24.126860 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1792/3684] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:23 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:25.147563 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:25.148811 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:25.155329 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:25.155920 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:25.156181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:25.156883 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:25.157336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:25.157743 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:25.287643 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:25.295538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5364d707-2975-4118-a5d0-c5895745b36b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.151938 Aug 29 23:24:25.296105 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1893/3685] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:25 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:26.316483 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:26.317061 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:26.323539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:26.324016 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:26.324504 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:26.325186 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:26.325644 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:26.326068 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:26.454130 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:26.462728 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-24ff1bf7-3946-4291-874d-32161e92fd35 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.150186 Aug 29 23:24:26.463296 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1793/3686] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:26 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:27.484409 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:27.485022 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:27.491529 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:27.492014 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:27.492493 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:27.493313 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:27.493686 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:27.494112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:27.625762 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:27.633772 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-4083c36b-386f-4087-9ef9-9c5733fac86b tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.153280 Aug 29 23:24:27.634342 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1894/3687] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:27 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:24:28.654945 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:28.658872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:28.662754 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:28.663242 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:28.663937 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:28.664677 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:28.665132 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:28.665560 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:28.794853 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:28.803308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f87f8c03-dc72-4979-ab27-8fc67b8b0ebf tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1570 microversion: 2.1 time: 0.152333 Aug 29 23:24:28.803915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1794/3688] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:28 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:28.823443 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:24:28.824042 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:28.830569 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:28.831052 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:28.831492 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:28.832215 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:28.832674 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:28.833101 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:28.873687 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128150) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 23:24:29.194938 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f1eb315f-5220-4f66-81b2-f16e295014a0 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "POST /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08/action" status: 202 len: 0 microversion: 2.1 time: 0.375177 Aug 29 23:24:29.195910 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1895/3689] 10.222.0.59 () {60 vars in 1278 bytes} [Mon Aug 29 23:24:28 2022] POST /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:24:29.203582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:29.204207 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:29.213429 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:29.213912 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:29.214342 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:29.215022 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:29.215465 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:29.215880 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:29.352378 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:29.361724 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-bfdc5cce-e37e-4566-b5bc-5d6211101651 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1518 microversion: 2.1 time: 0.161973 Aug 29 23:24:29.362299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1795/3690] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:29 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:29.523265 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-397b193e-029f-4727-84d4-cd55483e6266 req-515d898d-4824-4731-a4c9-6aa2ba5951ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4e3ba1-45b5-4cab-a9c0-7f8818458b08", "name": "network-vif-unplugged", "status": "completed", "tag": "763dbea8-741c-4d59-a5c4-0917f4feb1ef"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:24:29.534805 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-397b193e-029f-4727-84d4-cd55483e6266 req-515d898d-4824-4731-a4c9-6aa2ba5951ff service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:29.535437 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-397b193e-029f-4727-84d4-cd55483e6266 req-515d898d-4824-4731-a4c9-6aa2ba5951ff service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:29.536066 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-397b193e-029f-4727-84d4-cd55483e6266 req-515d898d-4824-4731-a4c9-6aa2ba5951ff service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:29.547739 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.compute.server_external_events [req-397b193e-029f-4727-84d4-cd55483e6266 req-515d898d-4824-4731-a4c9-6aa2ba5951ff service nova] Unable to find a host for instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08. Dropping event network-vif-unplugged {{(pid=128150) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 23:24:29.549386 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-397b193e-029f-4727-84d4-cd55483e6266 req-515d898d-4824-4731-a4c9-6aa2ba5951ff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029737 Aug 29 23:24:29.549982 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1896/3691] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 29 23:24:30.383374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:30.383983 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:30.390415 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:30.390911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:30.391349 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:30.392029 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:30.393235 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:30.393702 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:30.521445 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:30.529212 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-f51d7307-8f46-4739-869c-5813c89df18c tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1520 microversion: 2.1 time: 0.149651 Aug 29 23:24:30.529785 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1796/3692] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:30 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:31.553164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:31.553164 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:31.557670 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:31.558150 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:31.558585 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:31.559273 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:31.559728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:31.560181 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:31.692337 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:31.700017 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-59d894ee-341c-4336-958f-fc5b6bde14d5 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1520 microversion: 2.1 time: 0.153492 Aug 29 23:24:31.700612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1897/3693] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:31 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:32.722392 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:32.722898 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:32.729299 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:32.729786 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:32.730223 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:32.730911 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:32.731370 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:32.731819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:32.864108 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:32.871799 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-1e70027f-b3a7-4034-a887-9f15f98c8e72 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.154091 Aug 29 23:24:32.872434 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1797/3694] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:32 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:33.892646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:33.893244 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:33.899598 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:33.900069 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:33.900538 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:33.901213 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:33.901657 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:33.902077 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:34.030740 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:34.039499 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7dc588a5-29b6-4cb4-af0c-f232a1171f0f tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.150689 Aug 29 23:24:34.040063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1898/3695] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:33 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:35.061348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:35.061992 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:35.071663 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:35.072164 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:35.072626 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:35.073309 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:35.073755 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:35.074173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:35.205199 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:35.213499 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-08b8fb6a-92f9-4e7d-b304-f956a17d9916 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.156237 Aug 29 23:24:35.214070 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1798/3696] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:35 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:36.235431 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:36.236018 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:36.242751 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:36.243235 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:36.243673 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:36.244393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:36.244857 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:36.245282 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:36.375415 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:36.383711 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-f840d030-4575-447f-9ba0-5d58e88e0b8d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.152169 Aug 29 23:24:36.384333 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1899/3697] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:36 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:37.405893 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:37.406502 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:37.414283 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:37.414762 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:37.415196 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:37.415877 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:37.416356 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:37.416781 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:37.554970 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:37.562701 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-22e614eb-a5d4-46fa-9fc8-3ae47e46ffd3 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.160733 Aug 29 23:24:37.563278 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1799/3698] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:37 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:38.585001 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:38.585612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:38.592043 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:38.592554 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:38.592992 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:38.593676 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:38.594133 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:38.594553 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:38.724967 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:38.732644 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5ea47135-d90c-4481-ae1b-753d48e9dbd6 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.151496 Aug 29 23:24:38.733214 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1900/3699] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:38 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:39.754266 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:39.754861 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:39.761239 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:39.761721 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:39.762146 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:39.762824 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:39.763269 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:39.763686 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:39.891839 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:39.899700 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-853019ab-78de-4c53-aed9-3c5b863a16ed tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.150017 Aug 29 23:24:39.900293 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1800/3700] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:39 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:40.922728 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:40.923348 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:40.930629 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:40.931110 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:40.931549 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:40.932267 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:40.932722 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:40.933149 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:41.062517 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:41.070972 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-c4bc6db0-d019-43b3-9c15-440cabc99252 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.152101 Aug 29 23:24:41.071540 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1901/3701] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:40 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:41.612539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-00c7577a-de94-4e5a-b274-ce5365560cb6 req-4be4748d-ada4-4dfe-bf14-86378772c7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4e3ba1-45b5-4cab-a9c0-7f8818458b08", "name": "network-vif-plugged", "status": "completed", "tag": "763dbea8-741c-4d59-a5c4-0917f4feb1ef"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:24:41.622387 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-00c7577a-de94-4e5a-b274-ce5365560cb6 req-4be4748d-ada4-4dfe-bf14-86378772c7dc service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:41.622866 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-00c7577a-de94-4e5a-b274-ce5365560cb6 req-4be4748d-ada4-4dfe-bf14-86378772c7dc service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:41.623297 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-00c7577a-de94-4e5a-b274-ce5365560cb6 req-4be4748d-ada4-4dfe-bf14-86378772c7dc service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:41.634592 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-00c7577a-de94-4e5a-b274-ce5365560cb6 req-4be4748d-ada4-4dfe-bf14-86378772c7dc service nova] Creating event network-vif-plugged:763dbea8-741c-4d59-a5c4-0917f4feb1ef for instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 on hv-cinder-85426 Aug 29 23:24:41.639705 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-00c7577a-de94-4e5a-b274-ce5365560cb6 req-4be4748d-ada4-4dfe-bf14-86378772c7dc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030934 Aug 29 23:24:41.640308 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1801/3702] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:24:42.091840 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:42.092481 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:42.098981 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:42.099464 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:42.099909 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:42.100625 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:42.101085 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:42.105594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:42.105594 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:42.230747 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:42.238357 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-5c8597f0-3341-4d48-8fee-1d21df62be31 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.150368 Aug 29 23:24:42.238929 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1902/3703] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:42 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:43.259967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:43.260699 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:43.267803 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:43.268371 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:43.268814 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:43.269501 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:43.269957 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:43.270383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:43.403649 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:43.412204 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-ee565eec-2419-4194-ac38-41731af3a613 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1576 microversion: 2.1 time: 0.156424 Aug 29 23:24:43.418823 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1802/3704] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:43 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:24:44.433870 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:24:44.434500 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:24:44.436881 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:44.442290 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:44.442768 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:44.443199 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:44.443875 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:24:44.444362 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:24:44.444778 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:24:44.579393 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:24:44.592774 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-df0d638d-40de-4cbe-b468-b2d72b761ce2 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1563 microversion: 2.1 time: 0.162859 Aug 29 23:24:44.593343 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1903/3705] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:24:44 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:26:04.091553 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_api:SELECT=30 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:04.092582 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG dbcounter [-] [128151] Writing DB stats nova_cell1:SELECT=86 {{(pid=128151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:04.093451 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:26:04.093595 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Mon Aug 29 23:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 (ip 10.222.0.59) !!! Aug 29 23:26:04.096655 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_api:SELECT=1 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:04.097408 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG dbcounter [-] [128150] Writing DB stats nova_cell1:SELECT=10 {{(pid=128150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:04.099002 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:26:04.099629 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:26:04.108185 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:04.108688 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:04.109128 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:04.109882 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:04.110490 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:04.111102 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:04.139067 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Going to try to terminate instance {{(pid=128151) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:26:04.174274 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [req-bdb510d3-016b-4980-b473-88d8c33289a4 req-dfe99e96-c934-4aae-8ad0-12badea4f19e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4e3ba1-45b5-4cab-a9c0-7f8818458b08", "tag": "763dbea8-741c-4d59-a5c4-0917f4feb1ef"}]} {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:26:04.184027 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-bdb510d3-016b-4980-b473-88d8c33289a4 req-dfe99e96-c934-4aae-8ad0-12badea4f19e service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:04.184548 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-bdb510d3-016b-4980-b473-88d8c33289a4 req-dfe99e96-c934-4aae-8ad0-12badea4f19e service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:04.184979 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [req-bdb510d3-016b-4980-b473-88d8c33289a4 req-dfe99e96-c934-4aae-8ad0-12badea4f19e service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:04.197812 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.compute.server_external_events [req-bdb510d3-016b-4980-b473-88d8c33289a4 req-dfe99e96-c934-4aae-8ad0-12badea4f19e service nova] Creating event network-changed:763dbea8-741c-4d59-a5c4-0917f4feb1ef for instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 on hv-cinder-85426 Aug 29 23:26:04.203007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [req-bdb510d3-016b-4980-b473-88d8c33289a4 req-dfe99e96-c934-4aae-8ad0-12badea4f19e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112001 Aug 29 23:26:04.203615 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1904/3706] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:26:04.467913 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-3eb46d80-21a8-4d4a-bd0e-f5e85df93615 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 204 len: 0 microversion: 2.1 time: 0.379203 Aug 29 23:26:04.468539 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1803/3707] 10.222.0.59 () {58 vars in 1239 bytes} [Mon Aug 29 23:26:04 2022] DELETE /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:26:04.478189 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:26:04.479308 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:26:04.492612 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:04.493118 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:04.493565 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:04.494286 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:04.494748 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:04.495371 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:04.640211 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:26:04.648701 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-7b494b7a-5e19-4c73-b853-66aa5b6895ff tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.174989 Aug 29 23:26:04.649284 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1905/3708] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:26:04 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:26:05.671402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:26:05.672221 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:26:05.680606 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:05.681092 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:05.681573 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:05.682260 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:05.682714 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:05.683140 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:05.818173 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.policy [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:26:05.826403 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-8abfc6d4-4cfc-4fec-91d8-b9ce2abff62d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1569 microversion: 2.1 time: 0.159122 Aug 29 23:26:05.830872 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1804/3709] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:26:05 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:26:06.849504 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:26:06.850259 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:26:06.857169 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:06.857649 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:06.858079 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:06.858807 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:06.859256 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:06.860454 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:06.916408 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [req-2eb1405d-25e4-4300-b3d8-30ff4a2a9163 req-8967a44f-7ab1-4ad7-b13f-51719ec45a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4e3ba1-45b5-4cab-a9c0-7f8818458b08", "name": "network-vif-deleted", "tag": "763dbea8-741c-4d59-a5c4-0917f4feb1ef"}]} {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:26:06.930374 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-2eb1405d-25e4-4300-b3d8-30ff4a2a9163 req-8967a44f-7ab1-4ad7-b13f-51719ec45a08 service nova] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:06.930852 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-2eb1405d-25e4-4300-b3d8-30ff4a2a9163 req-8967a44f-7ab1-4ad7-b13f-51719ec45a08 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:06.931007 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:26:06.931281 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [req-2eb1405d-25e4-4300-b3d8-30ff4a2a9163 req-8967a44f-7ab1-4ad7-b13f-51719ec45a08 service nova] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:06.938989 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-08f1b39f-0dd8-4948-94b7-007644743a6a tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1383 microversion: 2.1 time: 0.094784 Aug 29 23:26:06.939564 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1906/3710] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:26:06 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1383 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:26:06.943348 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.compute.server_external_events [req-2eb1405d-25e4-4300-b3d8-30ff4a2a9163 req-8967a44f-7ab1-4ad7-b13f-51719ec45a08 service nova] Creating event network-vif-deleted:763dbea8-741c-4d59-a5c4-0917f4feb1ef for instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 on hv-cinder-85426 Aug 29 23:26:06.948383 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [req-2eb1405d-25e4-4300-b3d8-30ff4a2a9163 req-8967a44f-7ab1-4ad7-b13f-51719ec45a08 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101192 Aug 29 23:26:06.948967 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1805/3711] 10.222.0.59 () {64 vars in 1317 bytes} [Mon Aug 29 23:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:26:07.960502 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:26:07.961128 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.compute.api [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128150) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:26:07.967387 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:07.967852 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:07.968336 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:07.969063 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:07.969518 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:07.969944 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:08.004280 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:08.004765 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:08.005200 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG oslo_concurrency.lockutils [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:08.005646 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.objects.instance [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lazy-loading 'fault' on Instance uuid 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 {{(pid=128150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:26:08.048474 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.policy [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3acbdab00c64d84871545062a5b5311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6b1df0e5104fd6abb5dcf5497d2cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:26:08.056351 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-9363d25a-c33b-47a3-9334-ca72a8e4352d tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 200 len: 1224 microversion: 2.1 time: 0.099634 Aug 29 23:26:08.056919 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1907/3712] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:26:07 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:26:09.078402 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '>' {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:26:09.079819 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.compute.api [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] [instance: 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08] Fetching instance by UUID {{(pid=128151) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:26:09.085888 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:09.086363 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:09.086793 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:09.087468 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Acquiring lock "7ef697b0-8690-4044-8ada-38684217d1b2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:26:09.087915 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:26:09.088358 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG oslo_concurrency.lockutils [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Lock "7ef697b0-8690-4044-8ada-38684217d1b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:26:09.103520 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.wsgi [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] HTTP exception thrown: Instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 could not be found. Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Request method failure captured: Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: request: GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 HTTP/1.1 Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept: application/json Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Accept-Encoding: identity Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Connection: close Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Length: 0 Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Content-Type: application/json Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Host: 10.222.0.59 Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: Openstack-System-Scope: None Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: User-Agent: python-urllib3/1.26.12 Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Auth-Token: gAAAAABjDUn25YDiz_RxMf5Xrf_rIZDuZF6NwLJltmjEt0JGSfuD95PH5qS6UVm28fruhKL3eANamBuFVfs14n92p2WwZsV4J2RFDDBkYHV_T19cI9WcYoitjCyPvFeLFpbvLbF0O9RiBbniCJJdfgwo7jI1U6ET3V2nkUXVVKhw3WlBLD7IiN4 Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Id: None Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Domain-Name: None Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Identity-Status: Confirmed Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Is-Admin-Project: True Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Id: default Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Domain-Name: Default Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Id: fc6b1df0e5104fd6abb5dcf5497d2cb1 Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Project-Name: tempest-TestShelveInstance-939903801 Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Role: reader,member Aug 29 23:26:09.105168 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Roles: reader,member Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fc6b1df0e5104fd6abb5dcf5497d2cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fc6b1df0e5104fd6abb5dcf5497d2cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fc6b1df0e5104fd6abb5dcf5497d2cb1", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fc6b1df0e5104fd6abb5dcf5497d2cb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant: tempest-TestShelveInstance-939903801 Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Id: fc6b1df0e5104fd6abb5dcf5497d2cb1 Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-Tenant-Name: tempest-TestShelveInstance-939903801 Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User: tempest-TestShelveInstance-939903801-project Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Id: default Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Domain-Name: Default Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Id: d3acbdab00c64d84871545062a5b5311 Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: X-User-Name: tempest-TestShelveInstance-939903801-project Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: method: > Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: exception: Instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 could not be found. Aug 29 23:26:09.106611 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: action_args: {'id': '8c4e3ba1-45b5-4cab-a9c0-7f8818458b08'} Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: {{(pid=128151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 could not be found. Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:26:09.107334 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 could not be found. Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 could not be found. Aug 29 23:26:09.108500 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: ERROR nova.api.openstack.wsgi Aug 29 23:26:09.109516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: DEBUG nova.api.openstack.wsgi [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Returning 404 to user: Instance 8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 could not be found. {{(pid=128151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:26:09.109516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: INFO nova.api.openstack.requestlog [None req-7514f83d-9cb5-4b1f-9b1e-8fbbfa73947e tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08" status: 404 len: 111 microversion: 2.1 time: 0.032842 Aug 29 23:26:09.109516 dv-cinder-854268-3-iscsi devstack@n-api.service[128151]: [pid: 128151|app: 0|req: 1806/3713] 10.222.0.59 () {58 vars in 1236 bytes} [Mon Aug 29 23:26:09 2022] GET /compute/v2.1/servers/8c4e3ba1-45b5-4cab-a9c0-7f8818458b08 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:26:09.347112 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: DEBUG nova.api.openstack.wsgi [None req-a367e8aa-ac13-4737-b8fa-1d630811e301 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] Calling method '.version_select at 0x7febd4fdec10>' {{(pid=128150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:26:09.429257 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: INFO nova.api.openstack.requestlog [None req-a367e8aa-ac13-4737-b8fa-1d630811e301 tempest-TestShelveInstance-939903801 tempest-TestShelveInstance-939903801-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-826589568" status: 202 len: 0 microversion: 2.1 time: 0.085895 Aug 29 23:26:09.429844 dv-cinder-854268-3-iscsi devstack@n-api.service[128150]: [pid: 128150|app: 0|req: 1908/3714] 10.222.0.59 () {58 vars in 1251 bytes} [Mon Aug 29 23:26:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-826589568 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)